-- Logs begin at Tue 2022-07-26 16:24:42 UTC, end at Tue 2022-07-26 17:30:41 UTC. -- Jul 26 17:03:06.760100 dv-cinder-835384-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 17:03:06.770326 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 17:03:06.772485 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 17:03:06 2022] *** Jul 26 17:03:06.772485 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 17:03:06.772485 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 17:03:06.772485 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: nodename: dv-cinder-835384-17-iscsi Jul 26 17:03:06.772485 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: machine: x86_64 Jul 26 17:03:06.772485 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: clock source: unix Jul 26 17:03:06.772485 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: pcre jit disabled Jul 26 17:03:06.772485 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: detected number of CPU cores: 4 Jul 26 17:03:06.772485 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: current working directory: / Jul 26 17:03:06.772485 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: detected binary path: /usr/bin/uwsgi-core Jul 26 17:03:06.772485 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: your processes number limit is 47680 Jul 26 17:03:06.773580 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: your memory page size is 4096 bytes Jul 26 17:03:06.773580 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: detected max file descriptor number: 2048 Jul 26 17:03:06.773580 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: lock engine: pthread robust mutexes Jul 26 17:03:06.773580 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: thunder lock: enabled Jul 26 17:03:06.773580 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 17:03:06.773580 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 17:03:06.814023 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: Python main interpreter initialized at 0x557f7dcdc9c0 Jul 26 17:03:06.814023 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: python threads support enabled Jul 26 17:03:06.814023 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: your server socket listen backlog is limited to 100 connections Jul 26 17:03:06.814023 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: your mercy for graceful operations on workers is 90 seconds Jul 26 17:03:06.814583 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 17:03:06.814583 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: *** Operational MODE: preforking *** Jul 26 17:03:06.814786 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: *** uWSGI is running in multiple interpreter mode *** Jul 26 17:03:06.814786 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: spawned uWSGI master process (pid: 103542) Jul 26 17:03:06.815018 dv-cinder-835384-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 17:03:06.815588 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: spawned uWSGI worker 1 (pid: 103543, cores: 1) Jul 26 17:03:06.815928 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: spawned uWSGI worker 2 (pid: 103544, cores: 1) Jul 26 17:03:06.816158 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 17:03:07.579378 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 17:03:07.736767 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 17:03:08.737285 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 17:03:08.737285 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: from cryptography.utils import int_from_bytes Jul 26 17:03:08.737939 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 17:03:08.737939 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: from cryptography.utils import int_from_bytes Jul 26 17:03:09.412365 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 17:03:09.412365 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: from cryptography.utils import int_from_bytes Jul 26 17:03:09.413073 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 17:03:09.413073 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: from cryptography.utils import int_from_bytes Jul 26 17:03:11.762401 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 17:03:11.763204 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 17:03:11.763565 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 17:03:11.764036 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 17:03:11.764384 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 17:03:11.764898 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.765352 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.765780 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.766208 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.766635 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.767040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.767458 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.767871 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.768296 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.768647 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.769106 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.769523 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-17-iscsi {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.769937 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.770351 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.770830 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.771240 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.771640 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.772053 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.772460 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.773141 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.774167 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.774674 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.775189 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.776229 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.776649 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.777104 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.777526 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.777935 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.778361 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.778775 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.779345 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-17-iscsi {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.779765 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.780172 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.780585 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.781244 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.781665 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.782071 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.782489 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.782972 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.783386 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.783820 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.784231 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.784641 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.785102 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.785509 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.785914 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.786327 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.786740 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.787139 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.787566 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.787912 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.788326 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.788748 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.789211 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.789703 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.790050 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.790425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.791556 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.791905 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.792358 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.792763 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.793214 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.793635 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.794038 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.794447 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.794850 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.795253 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.795669 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.796085 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.796527 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.797051 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.797453 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.797960 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.798302 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.798728 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.799170 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.799614 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.800028 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.800454 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.800866 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.801344 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.801760 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.802187 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.802603 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.803037 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.803452 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.803800 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.804196 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.804599 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.805061 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.805467 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.805878 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.806283 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.807247 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.807656 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.808068 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.808483 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.808885 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.809322 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.809724 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.810134 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.810547 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.810948 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.811362 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.811780 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.812183 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.812585 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.813037 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.813448 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.813899 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.814300 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.814703 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.815120 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.815528 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.815930 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.816339 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.816741 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.817184 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.817610 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.818018 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.818426 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.818840 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.819247 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.819652 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.820055 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.820478 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.820876 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.821344 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.821752 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.822190 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.822832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.823113 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.823535 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.823967 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.824377 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.824786 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.825253 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.825687 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.826118 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.826590 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.826995 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.827421 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.827853 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.828271 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.828680 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.829135 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.829564 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.829977 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.830381 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.830809 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.831406 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.831759 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.832187 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.832608 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.833151 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.833570 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.833977 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.834398 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.834822 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.835245 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.835657 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.836091 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.836530 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.836938 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.837407 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.838361 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.838775 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.839181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.839591 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.840003 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.840433 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.840843 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.841298 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.841707 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.842110 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.842264 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 17:03:11.842988 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 17:03:11.843156 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.843307 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 17:03:11.843479 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.843608 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 17:03:11.843608 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 17:03:11.843881 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.844225 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.844369 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.844525 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.844669 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.844819 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.844993 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.845277 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.845438 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.845593 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.845864 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.846021 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.846240 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.846419 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.846583 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.846780 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.846977 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.847127 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.847411 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-17-iscsi {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.847563 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.847719 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.847974 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.848152 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.848305 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.848506 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.848669 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.848923 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.849099 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.849276 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.849530 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.849685 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.850023 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.850177 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.850399 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.850544 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.850690 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.851003 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.851152 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.851343 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.851554 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.851707 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.851958 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.852105 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.852257 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.852565 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.852741 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.852891 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.853125 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.853286 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.854297 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.854455 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-17-iscsi {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.854726 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.854892 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.855092 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.855253 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.855407 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.855729 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.855883 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.856130 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.856276 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.856426 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.856714 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.856869 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.857105 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.857257 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.857400 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.857739 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.857888 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.858061 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.858277 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.858439 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.858692 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.858840 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.858982 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.859544 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.859720 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.859849 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.860082 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.860350 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.860512 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.860651 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.860793 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.861050 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.861268 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.861417 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.861647 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.861793 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.861966 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.862223 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.862389 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.862536 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.862757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.862922 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.863068 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.863298 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.863527 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.863676 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.863870 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.864022 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.864268 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.864492 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.864674 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.864865 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.865054 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.865207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.865487 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.865649 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.865792 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.866031 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.866194 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.866576 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.866745 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.866892 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.867028 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.867159 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.867338 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.867639 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.867812 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.868030 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.868205 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.868356 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.868632 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.868806 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.869090 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.869271 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.869440 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.869630 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.869815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.870103 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.870292 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.870688 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.870844 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.870987 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.871218 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.871431 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.871598 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.871741 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.871943 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.872220 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.872375 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.872531 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.872746 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.872898 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.873201 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.873416 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.873561 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.873732 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.873873 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.874027 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.874331 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.874481 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.874624 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.874942 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.875094 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.875233 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.875399 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.875549 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.875821 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.875991 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.876147 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.876368 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.876530 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.876713 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.876952 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.877195 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.877339 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.877516 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.877665 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.877977 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.878147 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.878300 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.878572 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.878727 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.878869 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.879114 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.879291 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.879482 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.879680 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.879832 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.880086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.880236 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.880397 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.880696 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.880850 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.881027 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.881255 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.881393 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.881636 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.881769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.881946 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.882253 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.882407 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.882550 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.882780 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.882933 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.883161 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.883312 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.883457 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.883768 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.883934 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.884090 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.884367 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.884528 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.884723 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.884944 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.885110 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.885325 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.885506 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.885678 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.885991 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.886158 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.886315 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.886540 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.886693 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.886956 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.887125 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.887282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.887546 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.887710 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.887856 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:03:11.888119 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.888285 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.888516 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.888665 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.888863 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.889191 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.889346 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.889758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.889916 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.890062 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.890216 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.890342 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.890481 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.890804 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.890968 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.891124 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.891345 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.891497 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.891733 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.891881 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.892036 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.892338 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.892491 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.892635 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.892861 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.893108 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.893305 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.893464 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.893608 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.893915 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.894083 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.894239 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.894465 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.894618 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.894850 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.895008 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.895163 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.895467 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.895607 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.895808 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.895996 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.896147 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.896454 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.896605 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.896786 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.897113 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.897284 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.897458 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.897673 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.897824 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.898070 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.898228 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.898372 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.898711 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.898862 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.899008 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.899233 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.899385 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.899624 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.899785 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.899938 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.900791 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.900946 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.901324 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.901476 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.901714 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.901929 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.902294 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.902451 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.902602 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.902746 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.902978 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.903128 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.903272 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.903496 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.903648 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.903893 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.904038 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.904183 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.904496 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.904658 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.904802 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.905066 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.905215 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.905415 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.905588 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.905724 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.906029 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.906194 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.906337 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.906572 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.906724 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.906971 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.907118 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.907331 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.907580 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.907739 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.907884 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.908098 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.908263 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.908483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.908629 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.908772 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.909133 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.909285 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.909448 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.909663 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.909817 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.910047 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.910194 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.910338 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.910663 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.910823 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.910967 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.911225 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.911381 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.911560 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.911764 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.911925 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.912169 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.912300 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.912484 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.912778 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.912932 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.913187 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.913328 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.913471 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.913743 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.913911 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.914057 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.914300 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.914452 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.914692 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.914851 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.915018 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.915329 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.915478 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.915651 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.916258 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.916632 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.916632 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.916918 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.917168 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.917168 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.917607 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.917766 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.917766 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.918032 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.918184 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.918327 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.918469 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.918631 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.918813 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.918947 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.919120 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.919343 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.919496 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.919746 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.919908 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.920052 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.920353 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.920517 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.920671 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.920951 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.921172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.921330 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.921516 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.921679 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.921963 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.922112 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.922284 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.922546 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.922701 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.922915 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.923077 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.923221 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.923536 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.923688 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.923832 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.924061 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.924235 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.924454 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.924601 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.924777 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.925119 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.925274 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.925438 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.925648 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.925884 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.926059 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.926201 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.926374 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.926699 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.926850 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.927012 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.927334 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.927570 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.927793 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.927998 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.928142 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.928317 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.928624 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.928776 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.928933 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.929201 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.929354 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.929574 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.929734 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.929878 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.930190 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.930341 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.930518 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.930764 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.930914 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.931111 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.931326 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.932024 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.932276 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.932434 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.932646 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.932906 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.933086 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.933253 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.933472 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.933627 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.933856 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.934001 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.934190 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.934467 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.934621 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.934824 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.935010 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.935159 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.935449 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.935598 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.935752 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.935991 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.936198 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.936399 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.936555 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.936701 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.936940 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.937190 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.937336 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.937572 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.937745 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.937875 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.938091 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.938244 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.938475 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.938632 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.938791 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.939073 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.939227 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.939372 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.939606 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.939785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.939938 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.940135 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.940300 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.940574 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.940722 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.940881 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.941156 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.941308 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.941522 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.941687 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.941844 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.942135 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.942282 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.942438 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.942681 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.942900 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.943049 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.943211 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.943357 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.943652 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.943801 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.943943 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.944260 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.944406 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.944551 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.944770 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.944920 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.945191 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.945365 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.945512 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.945808 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.945956 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.946100 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.946413 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.946583 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.946727 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.946944 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.947156 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.947895 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.948211 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.948378 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.948524 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.948781 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.948935 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.949159 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.949326 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.949472 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.949770 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.949971 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.950152 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.950334 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.950497 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.950665 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.950855 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.951006 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.951333 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.951565 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.951821 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.951985 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.952200 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.952358 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.952502 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.952819 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.953102 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.953252 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.953393 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.953599 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.953800 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.953962 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.954106 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.954402 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.954582 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.954738 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.954944 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.955096 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.955294 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.955479 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.955628 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.955900 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.956048 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.956192 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.956604 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.956760 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.956760 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.957051 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.957197 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.957398 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.957564 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.957721 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.957991 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.958192 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.958351 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.958546 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.958718 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.958889 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.959080 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.959232 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.959508 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.959669 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.959837 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.960097 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.960253 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.960505 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.960644 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.960811 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.961030 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.961208 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.961359 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.961670 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.961835 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.961993 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.962199 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.962355 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.962624 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.962806 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.962961 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.963229 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.963368 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.963570 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.963774 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.963920 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.964252 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.964419 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.964638 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.964783 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.964928 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.965275 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.965451 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.965596 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.965818 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.965970 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.966180 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.966352 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.966516 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.966869 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.967015 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.967160 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.967367 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.967516 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.967672 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.967917 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.968069 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.968265 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.968462 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.968624 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.968865 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.969040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.969187 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.969490 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.969658 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.969826 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.970033 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.970185 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.970391 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.970561 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.970724 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.970988 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.971136 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.971280 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.971547 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.971700 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.971877 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.972089 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.972260 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.972499 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.972658 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.972803 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.973109 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.973262 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.973408 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.973623 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.973786 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.974002 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.974168 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.974313 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.974600 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.974750 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.974921 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.975162 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.975327 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.975527 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.975685 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.975828 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.976126 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.976276 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.976436 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.976661 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.976889 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.977065 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.977206 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.977453 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.977594 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.977885 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.978090 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.978246 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.978460 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.978626 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.978810 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.979118 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.979308 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.979464 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.979731 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.980038 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.980201 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.980345 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.980577 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.980731 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.981049 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.981273 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.981454 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.981631 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.981812 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.981961 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.982196 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.982361 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.982558 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.982706 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.982872 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.983175 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.983354 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.983500 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.983722 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.983876 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.984087 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.984506 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.984664 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.984989 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.985142 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.985289 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.985517 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.985699 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.985911 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.986085 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.986235 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.986533 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.986694 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.986850 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.987100 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.987254 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.987459 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.987654 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.987805 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.988074 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.988255 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.988392 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.988523 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.988658 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.988848 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.989076 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.989310 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.989458 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.989755 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.989909 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.990068 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.990234 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.990460 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.990632 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.990874 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.991022 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.991165 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.991462 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.991617 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.991761 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.991988 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.992141 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.992394 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.992541 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.992697 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.993132 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.993311 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.993311 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.993608 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.993754 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.994510 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.994668 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.994889 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.995206 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.995375 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.995522 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.995834 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.995989 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.996134 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.996372 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.996540 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.996756 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.996903 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.997146 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.997402 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.997571 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.997837 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.997987 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.998132 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.998451 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.998603 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.998762 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.998991 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.999144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.999352 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.999565 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.999702 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:11.999980 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.000142 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.000287 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.000531 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.000684 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.000871 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.001486 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.001631 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.001847 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.001847 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.002112 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.002270 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.002414 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.002568 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.002824 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.002975 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.003239 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.003401 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.003545 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.003825 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.003979 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.004157 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.004364 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.004530 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.004791 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.004941 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.005115 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.005391 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.005563 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.005719 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.006050 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.006202 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.006374 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.006587 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.006753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.006995 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.007145 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.007290 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.007575 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.007740 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.007925 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.008109 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.008260 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.008550 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.008699 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.009048 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.009231 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.009360 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.009675 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.010543 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.010698 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.010998 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.011157 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.011304 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.011566 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.011718 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.011904 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.012138 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.012291 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.012591 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.012757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.012902 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.013178 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.013348 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.013489 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.013793 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.013943 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.014087 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.014371 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.014528 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.014683 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.014903 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.015056 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.015310 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.015567 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.015722 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.015926 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.016089 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.016233 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.016557 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.016723 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.016879 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.017134 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.017314 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.017512 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.017711 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.017859 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.018122 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.018297 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.018441 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.018692 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.018831 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.019062 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.019209 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.019367 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.019680 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.019831 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.020013 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.020220 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.020383 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.020644 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.020795 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.020995 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.021275 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.021427 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.021629 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.021821 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.021984 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.022262 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.022413 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.022557 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.022828 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.022983 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.023157 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.023380 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.023532 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.023757 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.023927 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.024071 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.024363 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.024572 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.024715 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.024981 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.025152 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.025405 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.025637 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.025788 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.025942 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.026206 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.026371 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.026573 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.026857 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.027023 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.027167 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.027452 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.027604 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.027800 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.027984 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.028137 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.028433 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.028698 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.028895 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.029148 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.029294 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.029453 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.029594 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.029773 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.030018 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.030225 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.030371 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.030574 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.030737 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.030939 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.031100 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.031246 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.031559 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.031712 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.031869 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.032095 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.032246 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.032475 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.032642 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.032786 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.033115 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.033271 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.033416 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.033636 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.034003 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.034156 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.034321 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.034578 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.034728 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.034936 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.035131 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.035296 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.035556 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.035704 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.035874 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.036161 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.036316 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.036486 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.036712 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.036878 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.037111 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.037271 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.037448 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.037766 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.037934 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.038077 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.038296 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.038460 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.038732 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.038900 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.039097 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.039305 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.039457 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.039644 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.039837 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.039990 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.040314 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.040465 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.040610 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.041087 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.041258 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.041405 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.041717 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.041930 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.042317 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.042317 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.042598 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.042741 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.042933 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.043080 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.043238 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.043545 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.043697 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.043840 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.044087 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.044340 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.044488 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.044644 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.044850 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.045136 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.045285 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.045429 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.045695 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.045873 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.046057 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.046259 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.046639 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.046793 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.046954 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.047178 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.047331 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.047599 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.047750 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.047925 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.048183 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.048323 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.048567 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.048716 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.048897 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.049202 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.049377 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.049534 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.049741 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.049892 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.050135 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.050269 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.050440 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.050761 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.050974 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.051161 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.051316 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.051499 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.051788 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.051942 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.052087 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.052347 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.052560 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.052853 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.053043 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.053260 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.053407 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.053591 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.053921 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.054097 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.054255 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.054453 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.054619 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.054924 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.055160 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.055316 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.055607 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.055761 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.055908 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.056075 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.056240 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.057425 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.057815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.057963 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.057963 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.058249 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.058389 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.058389 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.058636 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.058792 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.058933 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.059078 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.059236 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.059430 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.059578 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.059845 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.059993 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.060176 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.060449 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.060649 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.060861 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.061077 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.061231 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.061394 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.061620 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.061787 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.062000 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.062161 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.062306 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.062610 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.062772 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.062916 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.063144 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.063296 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.063507 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.063675 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.063819 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.064140 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.064307 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.064470 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.064690 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.064876 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.065088 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.065276 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.065414 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.065749 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.066022 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.066161 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.066407 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.066665 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.066819 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.067064 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.067226 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.067373 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.067678 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.067950 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.068164 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.068317 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.068596 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.068758 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.068939 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.069207 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.069380 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.069609 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.069771 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.069918 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.070211 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.070364 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.070519 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.070748 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.070963 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.071136 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.071284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.071440 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.071748 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.071918 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.072092 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.072361 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.072780 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.072934 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.073279 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.073450 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.073595 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.073853 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.074008 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.074217 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.074407 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.074570 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.074782 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.074930 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.075077 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.075399 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.075572 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.075748 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.075941 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.076091 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.076379 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.076526 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.076686 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.077002 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.077157 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.077331 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.077548 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.077714 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.077945 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.078103 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.078249 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.078549 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.078702 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.078888 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.079094 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.079247 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.079498 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.079657 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.079933 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.080097 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.080241 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.080554 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.080707 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.080851 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.081121 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.081292 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.081512 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.081662 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.081835 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.082139 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.082308 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.082453 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.082689 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.082842 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.083078 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.083238 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.083418 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.083713 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.083868 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.084061 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.084275 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.084440 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.084659 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.084806 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.085103 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.085293 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.085442 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.085597 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.085867 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.086020 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.086199 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.086413 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.086564 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.086799 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.087107 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.087254 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.087418 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.088319 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.088486 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.088633 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.088843 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.089172 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.089341 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.089495 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.089653 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.089810 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.089995 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.090160 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.090337 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.090551 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.090723 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.090936 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.091109 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.091244 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.091537 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.091701 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.091847 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.092094 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.092247 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.092422 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.092625 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.092792 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.093110 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.093262 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.093426 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.093688 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.093840 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.094038 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.094219 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.094372 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.094660 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.094811 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.094981 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.095238 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.095412 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.095608 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.095806 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.095954 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.096243 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.096394 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.096537 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.096784 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.096939 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.097182 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.097499 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.097716 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.097869 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.098109 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.098272 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.098431 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.098756 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.098909 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.099053 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.099300 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.099457 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.099687 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.099850 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.099996 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.100306 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.100474 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.100619 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.100844 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.101120 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.101268 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.101425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.101563 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.101858 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.102030 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.102191 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.102412 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.102564 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.102764 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.102952 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.103221 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.104040 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.104193 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.104509 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.104661 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.104999 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.105174 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.105348 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.105556 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.105708 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.105980 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.106144 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.106288 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.106544 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.106698 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.106961 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.107131 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.107288 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.107540 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.107707 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.107925 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.108087 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.108242 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.108541 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.108694 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.108850 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.109108 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 17:03:12.109503 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.109824 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.110236 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.110638 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.111045 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.111516 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.111940 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.112418 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.112841 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.113287 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.113688 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.114097 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.114498 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.114917 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.115368 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.115872 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.116337 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.116737 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.117257 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.117677 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.118105 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.118516 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.118963 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.119413 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.119834 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.120528 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.120988 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.121410 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.121845 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.122276 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.122683 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.123085 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.123491 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.123917 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.124324 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.124732 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.125196 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.125602 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.126009 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.126422 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.126836 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.127249 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.127652 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.128057 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.128463 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.128935 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.129392 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.129842 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.130303 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.130728 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.131140 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.131551 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.131967 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.132377 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.132783 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.133240 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.133645 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.134072 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.134501 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.134954 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.135394 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.135924 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.136360 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.136801 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.137253 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.137670 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.138088 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.138504 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.138909 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.139555 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.139936 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.140328 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.140772 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.141248 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.141676 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.142180 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.142565 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.142967 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.143377 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.143791 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.144195 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.144628 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.145070 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.145481 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.145880 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.146285 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.146696 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.147105 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.147516 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.147912 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.148311 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.148709 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.149154 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.149567 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.149968 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.150919 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.151320 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.151720 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.152195 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.152619 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.153067 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.153524 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.153980 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.154397 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.154823 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.155231 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.155647 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.156054 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.156471 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.156889 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.157351 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.157763 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.158192 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.158597 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.159006 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.159413 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.159828 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.160263 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.160706 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.161194 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.161614 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.162029 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.162459 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.162898 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.163318 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.163742 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.164150 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.164589 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.165028 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.165442 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.166299 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.166474 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.166914 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.167373 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.167788 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.168202 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.168617 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.169074 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.169524 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.169951 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.170368 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.170791 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.171213 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.171683 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.172104 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.172544 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.173014 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.173429 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.173837 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.174240 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:03:12.174587 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 17:03:12.266431 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO dbcounter [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Registered counter for database nova_api Jul 26 17:03:12.293903 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_db.sqlalchemy.engines [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:03:12.302235 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writer thread running {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:03:12.336872 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO dbcounter [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] Registered counter for database nova_api Jul 26 17:03:12.361302 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG oslo_db.sqlalchemy.engines [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:03:12.366642 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.context [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de7d5e92-8d50-420a-84c5-3da3d0978a49(cell1) {{(pid=103544) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 17:03:12.369095 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG dbcounter [-] [103543] Writer thread running {{(pid=103543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:03:12.370955 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:03:12.372579 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:03:12.373452 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:03:12.375527 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:03:12.377815 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO dbcounter [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Registered counter for database nova_cell0 Jul 26 17:03:12.384089 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO dbcounter [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Registered counter for database nova_cell1 Jul 26 17:03:12.393812 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_db.sqlalchemy.engines [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:03:12.395377 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_db.sqlalchemy.engines [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:03:12.403643 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writer thread running {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:03:12.406653 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writer thread running {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:03:12.430232 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.context [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de7d5e92-8d50-420a-84c5-3da3d0978a49(cell1) {{(pid=103543) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 17:03:12.434711 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG oslo_concurrency.lockutils [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:03:12.436424 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG oslo_concurrency.lockutils [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:03:12.437431 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG oslo_concurrency.lockutils [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:03:12.439832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG oslo_concurrency.lockutils [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:03:12.442214 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO dbcounter [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] Registered counter for database nova_cell0 Jul 26 17:03:12.449257 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO dbcounter [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] Registered counter for database nova_cell1 Jul 26 17:03:12.457556 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG oslo_db.sqlalchemy.engines [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:03:12.461622 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG oslo_db.sqlalchemy.engines [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:03:12.469943 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG dbcounter [-] [103543] Writer thread running {{(pid=103543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:03:12.565613 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO dbcounter [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Registered counter for database nova_cell0 Jul 26 17:03:12.575299 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_db.sqlalchemy.engines [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:03:12.580552 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writer thread running {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:03:12.722454 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG dbcounter [-] [103543] Writer thread running {{(pid=103543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:03:12.741708 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO dbcounter [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] Registered counter for database nova_cell0 Jul 26 17:03:12.755566 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG oslo_db.sqlalchemy.engines [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:03:12.766999 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG dbcounter [-] [103543] Writer thread running {{(pid=103543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:03:12.934002 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: WARNING keystonemiddleware.auth_token [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 17:03:12.941483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: WARNING keystonemiddleware.auth_token [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 17:03:13.273315 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: WARNING keystonemiddleware.auth_token [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 17:03:13.281824 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: WARNING keystonemiddleware.auth_token [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 17:03:13.296016 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: WARNING keystonemiddleware.auth_token [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 17:03:13.302260 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: WARNING keystonemiddleware.auth_token [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 17:03:13.308371 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557f7dcdc9c0 pid: 103544 (default app) Jul 26 17:03:13.310690 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:03:13.311968 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001962 Jul 26 17:03:13.312457 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Tue Jul 26 17:03:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:03:13.657954 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: WARNING keystonemiddleware.auth_token [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 17:03:13.664297 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: WARNING keystonemiddleware.auth_token [None req-b335469f-ad2a-494c-9061-51ac6723fd17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 17:03:13.670404 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557f7dcdc9c0 pid: 103543 (default app) Jul 26 17:04:46.723119 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:04:46.724880 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002414 Jul 26 17:04:46.725697 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:04:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:04:46.755724 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG dbcounter [-] [103543] Writing DB stats nova_api:SELECT=3 {{(pid=103543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:04:46.758371 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG dbcounter [-] [103543] Writing DB stats nova_cell0:SELECT=3 {{(pid=103543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:04:46.759755 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG dbcounter [-] [103543] Writing DB stats nova_cell1:SELECT=3 {{(pid=103543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:04:46.761633 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG dbcounter [-] [103543] Writing DB stats nova_cell0:SELECT=3 {{(pid=103543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:04:47.965769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-dc3b510c-b4ea-4dd1-9c29-bee49f6d0363 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:04:48.003465 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-dc3b510c-b4ea-4dd1-9c29-bee49f6d0363 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.264857 Jul 26 17:04:48.004501 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Tue Jul 26 17:04:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:04:50.466159 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:04:50.468011 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-97d2a77b-7fe7-41fc-afb5-f6d224361eb2 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002400 Jul 26 17:04:50.471729 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:04:50 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:04:51.265235 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-088d4785-26f3-4098-8e7c-5614720c23f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "ram": 256, "swap": 0}} {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:04:51.304586 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 17:04:51.304586 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: warnings.warn(msg) Jul 26 17:04:51.353089 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-088d4785-26f3-4098-8e7c-5614720c23f4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.873935 Jul 26 17:04:51.355346 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Jul 26 17:04:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:04:51.818549 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-22e79cf7-97b5-4cb9-a98b-574b5ca0ee5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:04:51.826951 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 17:04:51.826951 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: warnings.warn(msg) Jul 26 17:04:51.859349 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writing DB stats nova_api:SELECT=3 {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:04:51.861223 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writing DB stats nova_cell0:SELECT=3 {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:04:51.862797 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writing DB stats nova_cell1:SELECT=3 {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:04:51.864510 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:04:51.958631 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-22e79cf7-97b5-4cb9-a98b-574b5ca0ee5d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.589368 Jul 26 17:04:51.959736 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Tue Jul 26 17:04:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:04:54.744940 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-088d4785-26f3-4098-8e7c-5614720c23f4 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:04:54.746397 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-088d4785-26f3-4098-8e7c-5614720c23f4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Jul 26 17:04:54.747368 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:04:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:04:55.674627 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-3642a297-13f8-4e8e-9a32-4c7b42133ba2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "id": "d1", "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:04:55.699020 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 17:04:55.699020 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: warnings.warn(msg) Jul 26 17:04:55.726374 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-3642a297-13f8-4e8e-9a32-4c7b42133ba2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.971056 Jul 26 17:04:55.727871 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Jul 26 17:04:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 17:04:55.749598 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-37b259af-cdb7-4b42-856f-377fcccf2b6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:04:55.755169 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 17:04:55.755169 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: warnings.warn(msg) Jul 26 17:04:55.816755 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-37b259af-cdb7-4b42-856f-377fcccf2b6b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074513 Jul 26 17:04:55.818227 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Tue Jul 26 17:04:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:04:58.842432 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-3642a297-13f8-4e8e-9a32-4c7b42133ba2 admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:04:58.843896 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-3642a297-13f8-4e8e-9a32-4c7b42133ba2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001719 Jul 26 17:04:58.844473 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:04:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:04:59.358787 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-a848a552-59da-4121-9dda-67df4bd5d146 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:04:59.383383 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-a848a552-59da-4121-9dda-67df4bd5d146 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.532075 Jul 26 17:04:59.384228 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Jul 26 17:04:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:04:59.402886 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-75b302a7-4419-46ac-8f11-928bf00c464e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:04:59.446714 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-75b302a7-4419-46ac-8f11-928bf00c464e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051175 Jul 26 17:04:59.447688 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Tue Jul 26 17:04:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:05:02.065262 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-a848a552-59da-4121-9dda-67df4bd5d146 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:02.066293 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-a848a552-59da-4121-9dda-67df4bd5d146 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jul 26 17:05:02.066709 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:05:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:05:02.703792 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-0ba580ff-411d-4cbb-a80d-af4b82baf4c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:02.737272 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-0ba580ff-411d-4cbb-a80d-af4b82baf4c7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.663651 Jul 26 17:05:02.738333 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Jul 26 17:05:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:05:02.755591 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-053f1e31-6e85-423e-a523-213cc2695936 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:02.792506 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-053f1e31-6e85-423e-a523-213cc2695936 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040509 Jul 26 17:05:02.793729 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Tue Jul 26 17:05:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:05:05.894093 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-0ba580ff-411d-4cbb-a80d-af4b82baf4c7 admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:05.895493 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-0ba580ff-411d-4cbb-a80d-af4b82baf4c7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001877 Jul 26 17:05:05.896058 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:05:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:05:06.500609 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-0697bc99-efed-4928-b1f5-98cf00dbfcd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:06.525992 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-0697bc99-efed-4928-b1f5-98cf00dbfcd3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.621984 Jul 26 17:05:06.533996 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Jul 26 17:05:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:05:06.539788 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-7b7cb2d1-dd0b-421a-88e9-e2291788e173 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:06.577364 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-7b7cb2d1-dd0b-421a-88e9-e2291788e173 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041292 Jul 26 17:05:06.579493 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Tue Jul 26 17:05:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:05:09.779602 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-0697bc99-efed-4928-b1f5-98cf00dbfcd3 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:09.781002 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-0697bc99-efed-4928-b1f5-98cf00dbfcd3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Jul 26 17:05:09.781710 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:05:10.444806 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-4757aaac-fdf0-454b-9dee-062c7992ab1b admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:10.476406 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-4757aaac-fdf0-454b-9dee-062c7992ab1b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.682218 Jul 26 17:05:10.477828 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Tue Jul 26 17:05:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:05:13.458106 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-0697bc99-efed-4928-b1f5-98cf00dbfcd3 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:13.460161 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-0697bc99-efed-4928-b1f5-98cf00dbfcd3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 Jul 26 17:05:13.460699 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:05:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:05:13.945806 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-2d5c9563-be41-45ea-ba13-f4281a9a1729 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:13.966577 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-2d5c9563-be41-45ea-ba13-f4281a9a1729 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.498873 Jul 26 17:05:13.967142 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Jul 26 17:05:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 17:05:13.980395 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-3c50cd83-1e77-4887-92fa-050ceb2a824d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:14.009470 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-3c50cd83-1e77-4887-92fa-050ceb2a824d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033060 Jul 26 17:05:14.010066 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Tue Jul 26 17:05:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:05:16.584953 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-2d5c9563-be41-45ea-ba13-f4281a9a1729 admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:16.587533 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-2d5c9563-be41-45ea-ba13-f4281a9a1729 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001945 Jul 26 17:05:16.587533 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:05:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:05:17.217082 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-ef8afd0d-1415-41b4-98a3-325cfbe64ea4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:17.229276 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG dbcounter [-] [103543] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:05:17.267351 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-ef8afd0d-1415-41b4-98a3-325cfbe64ea4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.672827 Jul 26 17:05:17.275047 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Jul 26 17:05:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:05:17.285886 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-9b7f5a0e-1936-442b-83b4-34f715d3c815 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:17.322243 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-9b7f5a0e-1936-442b-83b4-34f715d3c815 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039768 Jul 26 17:05:17.323209 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Tue Jul 26 17:05:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:05:20.058675 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-ef8afd0d-1415-41b4-98a3-325cfbe64ea4 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:20.059685 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-ef8afd0d-1415-41b4-98a3-325cfbe64ea4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 26 17:05:20.061159 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:05:20.847322 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-979f8f8c-c684-4ab7-b7da-327e9e5c496c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "disk": 40, "ram": 4096, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:20.881037 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-979f8f8c-c684-4ab7-b7da-327e9e5c496c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.813411 Jul 26 17:05:20.892994 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Jul 26 17:05:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 17:05:20.904430 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-b5988f86-5e05-4f8f-9d4a-d174881aec4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:20.938557 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-b5988f86-5e05-4f8f-9d4a-d174881aec4e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038651 Jul 26 17:05:20.939330 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Tue Jul 26 17:05:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:05:24.043813 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-979f8f8c-c684-4ab7-b7da-327e9e5c496c admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:24.044744 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-979f8f8c-c684-4ab7-b7da-327e9e5c496c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 26 17:05:24.045474 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:05:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:05:24.729294 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-08ffd3a7-ab81-4060-9e9c-f3f2aae7a900 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:24.760221 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-08ffd3a7-ab81-4060-9e9c-f3f2aae7a900 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.707685 Jul 26 17:05:24.760902 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Jul 26 17:05:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:05:24.779831 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-33bb5a49-d13f-47f6-8d1c-5b3622ceed57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:24.789968 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:05:24.824347 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-33bb5a49-d13f-47f6-8d1c-5b3622ceed57 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050407 Jul 26 17:05:24.824347 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Tue Jul 26 17:05:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:05:28.154671 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-08ffd3a7-ab81-4060-9e9c-f3f2aae7a900 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:28.157580 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-08ffd3a7-ab81-4060-9e9c-f3f2aae7a900 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003633 Jul 26 17:05:28.158361 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:05:28 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:05:28.920372 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-7a079ab0-2c60-44d3-bdd1-7f28bf2e9a41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8, "disk": 160, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:28.956582 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-7a079ab0-2c60-44d3-bdd1-7f28bf2e9a41 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.786676 Jul 26 17:05:28.957557 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Tue Jul 26 17:05:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:05:28.981506 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-97a75f60-c8a5-4da9-bd32-3ffbaa882548 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:29.026962 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-97a75f60-c8a5-4da9-bd32-3ffbaa882548 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059892 Jul 26 17:05:29.028046 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Tue Jul 26 17:05:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:05:48.197690 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-7a079ab0-2c60-44d3-bdd1-7f28bf2e9a41 admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:48.198715 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-7a079ab0-2c60-44d3-bdd1-7f28bf2e9a41 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jul 26 17:05:48.199126 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:05:48.210655 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG dbcounter [-] [103543] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=103543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:05:48.740720 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-190f4eb9-0461-4b2f-a41a-c586bec1550f admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:48.761681 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-190f4eb9-0461-4b2f-a41a-c586bec1550f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.555549 Jul 26 17:05:48.762463 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Tue Jul 26 17:05:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:05:50.033879 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-7a079ab0-2c60-44d3-bdd1-7f28bf2e9a41 admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:50.035521 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-7a079ab0-2c60-44d3-bdd1-7f28bf2e9a41 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002356 Jul 26 17:05:50.036262 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Jul 26 17:05:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:05:50.950631 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-05057521-5194-4e72-8007-b3d5b4145ac7 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:50.956804 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.wsgi [None req-05057521-5194-4e72-8007-b3d5b4145ac7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-05057521-5194-4e72-8007-b3d5b4145ac7 admin admin] Request method failure captured: Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Accept: application/json Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Accept-Encoding: gzip, deflate Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Connection: keep-alive Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Content-Length: 0 Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Host: 10.222.0.48 Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Openstack-Api-Version: compute 2.90 Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Openstack-System-Scope: None Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: User-Agent: python-novaclient Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Auth-Token: gAAAAABi4B7tYgq8qdYbXLXVTI5qg2KTyloBEpLoDEF6cEcayhIFHcISaKTJ5SGcFvhbayy3WlHYO57CXRBcQhI_rKAXJ-lW_kZCFKclFFaE4YwcyxNZwbBFND203V0DFQA4mkROFmCKqDmu4mOzj6nwC0RoPI6YRvPtsAFLwl7i1rtV8XeFAOk Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Domain-Id: None Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Domain-Name: None Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Identity-Status: Confirmed Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Is-Admin-Project: True Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Project-Domain-Id: default Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Project-Domain-Name: Default Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Project-Id: f28d3ad4783445e5a27ff264d5fb4f43 Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Project-Name: admin Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Role: member,reader,admin Jul 26 17:05:50.960234 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Roles: member,reader,admin Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Tenant: admin Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Tenant-Id: f28d3ad4783445e5a27ff264d5fb4f43 Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Tenant-Name: admin Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User: admin Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User-Domain-Id: default Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User-Domain-Name: Default Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User-Id: 16f5c0d2019f40b59c659bd14cb74047 Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User-Name: admin Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: method: > Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: exception: Flavor 42 could not be found. Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: action_args: {'id': '42'} Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:05:50.962143 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:05:50.963040 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:50.964181 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-05057521-5194-4e72-8007-b3d5b4145ac7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:05:50.965604 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-05057521-5194-4e72-8007-b3d5b4145ac7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.641326 Jul 26 17:05:50.965604 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Tue Jul 26 17:05:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 644 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 17:05:50.975639 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-994306b2-0eb1-4482-997c-cdfd0639c85a admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:50.980086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:05:51.004049 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-994306b2-0eb1-4482-997c-cdfd0639c85a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033665 Jul 26 17:05:51.004696 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Tue Jul 26 17:05:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:05:51.016029 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-ae03c104-5805-4412-b5c4-ef69af623594 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:51.042338 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-ae03c104-5805-4412-b5c4-ef69af623594 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030367 Jul 26 17:05:51.043372 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Tue Jul 26 17:05:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:05:51.054735 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-62b9b2fc-125a-44e7-891e-da1a1fec4cfe admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:51.061372 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.wsgi [None req-62b9b2fc-125a-44e7-891e-da1a1fec4cfe admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-62b9b2fc-125a-44e7-891e-da1a1fec4cfe admin admin] Request method failure captured: Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Accept: application/json Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Accept-Encoding: gzip, deflate Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Connection: keep-alive Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Content-Length: 0 Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Host: 10.222.0.48 Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Openstack-Api-Version: compute 2.90 Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Openstack-System-Scope: None Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: User-Agent: python-novaclient Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Auth-Token: gAAAAABi4B7tYgq8qdYbXLXVTI5qg2KTyloBEpLoDEF6cEcayhIFHcISaKTJ5SGcFvhbayy3WlHYO57CXRBcQhI_rKAXJ-lW_kZCFKclFFaE4YwcyxNZwbBFND203V0DFQA4mkROFmCKqDmu4mOzj6nwC0RoPI6YRvPtsAFLwl7i1rtV8XeFAOk Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Domain-Id: None Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Domain-Name: None Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Identity-Status: Confirmed Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Is-Admin-Project: True Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Project-Domain-Id: default Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Project-Domain-Name: Default Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Project-Id: f28d3ad4783445e5a27ff264d5fb4f43 Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Project-Name: admin Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Role: member,reader,admin Jul 26 17:05:51.064758 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Roles: member,reader,admin Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Tenant: admin Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Tenant-Id: f28d3ad4783445e5a27ff264d5fb4f43 Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Tenant-Name: admin Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User: admin Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User-Domain-Id: default Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User-Domain-Name: Default Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User-Id: 16f5c0d2019f40b59c659bd14cb74047 Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User-Name: admin Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: method: > Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: exception: Flavor 42 could not be found. Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: action_args: {'id': '42'} Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:05:51.067957 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:05:51.069785 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:51.072172 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-62b9b2fc-125a-44e7-891e-da1a1fec4cfe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:05:51.074486 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-62b9b2fc-125a-44e7-891e-da1a1fec4cfe admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016632 Jul 26 17:05:51.074486 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Tue Jul 26 17:05:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 17:05:52.172945 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-ae03c104-5805-4412-b5c4-ef69af623594 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:52.173995 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-ae03c104-5805-4412-b5c4-ef69af623594 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jul 26 17:05:52.174399 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Jul 26 17:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:05:52.924268 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-3b9ed61f-5bd2-4296-a5a2-6c2ff46ee0e1 admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:52.931679 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.wsgi [None req-3b9ed61f-5bd2-4296-a5a2-6c2ff46ee0e1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-3b9ed61f-5bd2-4296-a5a2-6c2ff46ee0e1 admin admin] Request method failure captured: Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Accept: application/json Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Accept-Encoding: gzip, deflate Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Connection: keep-alive Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Content-Length: 0 Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Host: 10.222.0.48 Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Openstack-Api-Version: compute 2.90 Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Openstack-System-Scope: None Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: User-Agent: python-novaclient Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Auth-Token: gAAAAABi4B7wrgxTCFaxlTERRIdbkqKUN_1GNexb_ujLj7W79jJNn1SIBmwhjKV2IyJNkrwiR5Lzc3XOckKEWD_4xjU8V4n_uc1LSDDYm-qznj8av7dbn5s3OMTpcQGZoiDYsOej1RXFKaYwjUzGySu9_PzNeKIosFGaoQxFDbn_JwcHq_pkOvU Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Domain-Id: None Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Domain-Name: None Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Identity-Status: Confirmed Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Is-Admin-Project: True Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Project-Domain-Id: default Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Project-Domain-Name: Default Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Project-Id: f28d3ad4783445e5a27ff264d5fb4f43 Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Project-Name: admin Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Role: member,reader,admin Jul 26 17:05:52.935144 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Roles: member,reader,admin Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Tenant: admin Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Tenant-Id: f28d3ad4783445e5a27ff264d5fb4f43 Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Tenant-Name: admin Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User: admin Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User-Domain-Id: default Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User-Domain-Name: Default Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User-Id: 16f5c0d2019f40b59c659bd14cb74047 Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User-Name: admin Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: method: > Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: exception: Flavor 84 could not be found. Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: action_args: {'id': '84'} Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:05:52.938086 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:05:52.940014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:52.942483 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-3b9ed61f-5bd2-4296-a5a2-6c2ff46ee0e1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:05:52.945697 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-3b9ed61f-5bd2-4296-a5a2-6c2ff46ee0e1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.601457 Jul 26 17:05:52.945697 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Tue Jul 26 17:05:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 603 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 17:05:52.955331 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-ccfa53d4-a0a8-47b8-991a-eb15815d9f26 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:52.984802 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-ccfa53d4-a0a8-47b8-991a-eb15815d9f26 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.036163 Jul 26 17:05:52.986159 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Tue Jul 26 17:05:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:05:52.999649 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-a7fc7597-7be3-42c5-9abf-d7fc9b9ccf8c admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:53.017961 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-a7fc7597-7be3-42c5-9abf-d7fc9b9ccf8c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022145 Jul 26 17:05:53.018552 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Tue Jul 26 17:05:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:05:53.035518 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-0aa0f577-eee2-4c60-b2da-2533456a3b23 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:53.045429 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.wsgi [None req-0aa0f577-eee2-4c60-b2da-2533456a3b23 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-0aa0f577-eee2-4c60-b2da-2533456a3b23 admin admin] Request method failure captured: Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Accept: application/json Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Accept-Encoding: gzip, deflate Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Connection: keep-alive Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Content-Length: 0 Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Host: 10.222.0.48 Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Openstack-Api-Version: compute 2.90 Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Openstack-System-Scope: None Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: User-Agent: python-novaclient Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Auth-Token: gAAAAABi4B7wrgxTCFaxlTERRIdbkqKUN_1GNexb_ujLj7W79jJNn1SIBmwhjKV2IyJNkrwiR5Lzc3XOckKEWD_4xjU8V4n_uc1LSDDYm-qznj8av7dbn5s3OMTpcQGZoiDYsOej1RXFKaYwjUzGySu9_PzNeKIosFGaoQxFDbn_JwcHq_pkOvU Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Domain-Id: None Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Domain-Name: None Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Identity-Status: Confirmed Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Is-Admin-Project: True Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Project-Domain-Id: default Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Project-Domain-Name: Default Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Project-Id: f28d3ad4783445e5a27ff264d5fb4f43 Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Project-Name: admin Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Role: member,reader,admin Jul 26 17:05:53.048126 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Roles: member,reader,admin Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Tenant: admin Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Tenant-Id: f28d3ad4783445e5a27ff264d5fb4f43 Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Tenant-Name: admin Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User: admin Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User-Domain-Id: default Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User-Domain-Name: Default Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User-Id: 16f5c0d2019f40b59c659bd14cb74047 Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User-Name: admin Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: method: > Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: exception: Flavor 84 could not be found. Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: action_args: {'id': '84'} Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:05:53.049815 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:05:53.050757 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:53.051832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-0aa0f577-eee2-4c60-b2da-2533456a3b23 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:05:53.053466 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-0aa0f577-eee2-4c60-b2da-2533456a3b23 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.021736 Jul 26 17:05:53.053466 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Tue Jul 26 17:05:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 17:05:54.266248 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-a7fc7597-7be3-42c5-9abf-d7fc9b9ccf8c admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:54.267386 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-a7fc7597-7be3-42c5-9abf-d7fc9b9ccf8c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Jul 26 17:05:54.267837 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Jul 26 17:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:05:55.043572 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-88d7796a-ee11-4623-9ab3-48e6cdfca6ac admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:55.049717 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.wsgi [None req-88d7796a-ee11-4623-9ab3-48e6cdfca6ac admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-88d7796a-ee11-4623-9ab3-48e6cdfca6ac admin admin] Request method failure captured: Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Accept: application/json Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Accept-Encoding: gzip, deflate Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Connection: keep-alive Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Content-Length: 0 Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Host: 10.222.0.48 Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Openstack-Api-Version: compute 2.90 Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Openstack-System-Scope: None Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: User-Agent: python-novaclient Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Auth-Token: gAAAAABi4B7ywGwpv8ay3W3_Ll54NWUI33LaYcOguAoG4DJMxPk7gOlnLKNQHgd8zmku-fSOHe-uolY0sgcaYGtHtmukp5Ip3T0fqQPD2uYwcP7lNoDV1GB1iJDQ-UJMXQnEWLYwTjDgDOchiDF10kgxtAutgicniT1ZJ9vwb-xnCVnIiOStjOg Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Domain-Id: None Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Domain-Name: None Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Identity-Status: Confirmed Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Is-Admin-Project: True Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Project-Domain-Id: default Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Project-Domain-Name: Default Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Project-Id: f28d3ad4783445e5a27ff264d5fb4f43 Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Project-Name: admin Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Role: member,reader,admin Jul 26 17:05:55.051284 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Roles: member,reader,admin Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Tenant: admin Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Tenant-Id: f28d3ad4783445e5a27ff264d5fb4f43 Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-Tenant-Name: admin Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User: admin Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User-Domain-Id: default Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User-Domain-Name: Default Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User-Id: 16f5c0d2019f40b59c659bd14cb74047 Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: X-User-Name: admin Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: method: > Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: exception: Flavor 451 could not be found. Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: action_args: {'id': '451'} Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:05:55.053769 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:05:55.055011 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: ERROR nova.api.openstack.wsgi Jul 26 17:05:55.056425 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-88d7796a-ee11-4623-9ab3-48e6cdfca6ac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:05:55.057832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-88d7796a-ee11-4623-9ab3-48e6cdfca6ac admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.630540 Jul 26 17:05:55.057832 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Jul 26 17:05:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 632 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 17:05:55.066900 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-3131508c-f40e-44e4-afe7-e62eca8b0d53 admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:55.098012 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-3131508c-f40e-44e4-afe7-e62eca8b0d53 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.037615 Jul 26 17:05:55.098976 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Tue Jul 26 17:05:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:05:55.116518 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:55.146800 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.037114 Jul 26 17:05:55.147789 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Tue Jul 26 17:05:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:05:55.161469 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-bb72ab6a-0ae5-4619-abbd-aadca5c1739f admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:55.168617 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.wsgi [None req-bb72ab6a-0ae5-4619-abbd-aadca5c1739f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-bb72ab6a-0ae5-4619-abbd-aadca5c1739f admin admin] Request method failure captured: Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Accept: application/json Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Accept-Encoding: gzip, deflate Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Connection: keep-alive Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Content-Length: 0 Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Host: 10.222.0.48 Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Openstack-Api-Version: compute 2.90 Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Openstack-System-Scope: None Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: User-Agent: python-novaclient Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Auth-Token: gAAAAABi4B7ywGwpv8ay3W3_Ll54NWUI33LaYcOguAoG4DJMxPk7gOlnLKNQHgd8zmku-fSOHe-uolY0sgcaYGtHtmukp5Ip3T0fqQPD2uYwcP7lNoDV1GB1iJDQ-UJMXQnEWLYwTjDgDOchiDF10kgxtAutgicniT1ZJ9vwb-xnCVnIiOStjOg Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Domain-Id: None Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Domain-Name: None Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Identity-Status: Confirmed Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Is-Admin-Project: True Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Project-Domain-Id: default Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Project-Domain-Name: Default Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Project-Id: f28d3ad4783445e5a27ff264d5fb4f43 Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Project-Name: admin Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Role: member,reader,admin Jul 26 17:05:55.170207 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Roles: member,reader,admin Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f28d3ad4783445e5a27ff264d5fb4f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Tenant: admin Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Tenant-Id: f28d3ad4783445e5a27ff264d5fb4f43 Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-Tenant-Name: admin Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User: admin Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User-Domain-Id: default Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User-Domain-Name: Default Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User-Id: 16f5c0d2019f40b59c659bd14cb74047 Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: X-User-Name: admin Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: method: > Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: exception: Flavor 451 could not be found. Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: action_args: {'id': '451'} Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:05:55.172753 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:05:55.174282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: ERROR nova.api.openstack.wsgi Jul 26 17:05:55.176143 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-bb72ab6a-0ae5-4619-abbd-aadca5c1739f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:05:55.178309 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-bb72ab6a-0ae5-4619-abbd-aadca5c1739f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014051 Jul 26 17:05:55.178309 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Jul 26 17:05:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 17:05:56.328542 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:56.329640 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jul 26 17:05:56.330055 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Jul 26 17:05:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:05:56.988592 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-8c789f60-3011-4813-a389-8950f07db0e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:57.010973 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-8c789f60-3011-4813-a389-8950f07db0e6 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.529974 Jul 26 17:05:57.011532 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Tue Jul 26 17:05:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 17:05:58.148297 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:58.151560 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002191 Jul 26 17:05:58.151560 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Jul 26 17:05:58 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:05:58.848730 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-b9c24027-bbcf-4eca-9034-920a9dd2c16a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:05:58.870903 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-b9c24027-bbcf-4eca-9034-920a9dd2c16a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.571114 Jul 26 17:05:58.871525 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Tue Jul 26 17:05:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:05:59.975208 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:05:59.976508 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002136 Jul 26 17:05:59.977001 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Jul 26 17:05:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:06:00.722751 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-cd2404fb-6184-4eab-9f8c-174b66dd4fdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:06:00.755125 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-cd2404fb-6184-4eab-9f8c-174b66dd4fdd admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.629459 Jul 26 17:06:00.756128 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Tue Jul 26 17:06:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 17:06:01.895904 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:06:01.897761 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002285 Jul 26 17:06:01.898237 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Jul 26 17:06:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:06:02.552830 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-772cbbe7-7502-464a-92d3-60c47a37f2b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:06:02.574431 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-772cbbe7-7502-464a-92d3-60c47a37f2b1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.530461 Jul 26 17:06:02.575071 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Tue Jul 26 17:06:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:06:03.640788 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:06:03.641905 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Jul 26 17:06:03.642314 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Jul 26 17:06:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:06:04.263977 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-b27d4890-d067-46fa-934d-fc5b6c352c55 admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:06:04.286451 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-b27d4890-d067-46fa-934d-fc5b6c352c55 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.501596 Jul 26 17:06:04.287594 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Tue Jul 26 17:06:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:07:04.529500 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:07:04.530884 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-56d36ea2-d87d-470b-851c-515176fafb13 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001734 Jul 26 17:07:04.531365 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Tue Jul 26 17:07:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:07:04.540179 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:07:05.035334 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-f807d73b-2053-453a-b676-dad909236385 admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:07:05.057278 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-f807d73b-2053-453a-b676-dad909236385 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.518623 Jul 26 17:07:05.057853 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Tue Jul 26 17:07:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:07:05.092665 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG dbcounter [-] [103543] Writing DB stats nova_api:SELECT=14 {{(pid=103543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:07:05.096557 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-98b2dd75-3fad-4dd1-bcbe-813fccb6331a admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:07:05.105393 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-98b2dd75-3fad-4dd1-bcbe-813fccb6331a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013972 Jul 26 17:07:05.105873 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Tue Jul 26 17:07:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:07:05.119282 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-02d2bd05-f6bc-4654-b7ae-6c433200a37d admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:07:05.127359 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-02d2bd05-f6bc-4654-b7ae-6c433200a37d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011685 Jul 26 17:07:05.127934 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Tue Jul 26 17:07:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:07:05.140901 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-f765d464-1450-4a9d-80f8-d36153ab41ff admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:07:05.149847 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-f765d464-1450-4a9d-80f8-d36153ab41ff admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012724 Jul 26 17:07:05.150436 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Tue Jul 26 17:07:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:07:05.168214 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-2401e3a6-439f-4240-9bd5-1445fe28ffed admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:07:05.177273 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-2401e3a6-439f-4240-9bd5-1445fe28ffed admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012626 Jul 26 17:07:05.178133 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Tue Jul 26 17:07:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:10:51.781578 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-f765d464-1450-4a9d-80f8-d36153ab41ff admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:10:51.783131 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-f765d464-1450-4a9d-80f8-d36153ab41ff admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 Jul 26 17:10:51.783555 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Jul 26 17:10:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:10:51.943281 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writing DB stats nova_api:SELECT=6 {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:10:52.136145 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-221cd00c-2cba-44e6-8d3c-3692b8568fff admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:10:52.139001 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 17:10:52.139001 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: warnings.warn(msg) Jul 26 17:10:52.141252 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-221cd00c-2cba-44e6-8d3c-3692b8568fff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:10:52.142051 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-221cd00c-2cba-44e6-8d3c-3692b8568fff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:10:52.143481 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-221cd00c-2cba-44e6-8d3c-3692b8568fff admin admin] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:10:52.144311 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-221cd00c-2cba-44e6-8d3c-3692b8568fff admin admin] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:10:52.200933 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-221cd00c-2cba-44e6-8d3c-3692b8568fff admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.259366 Jul 26 17:10:52.201480 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Jul 26 17:10:51 2022] GET /compute/v2.1/os-services => generated 794 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 17:10:53.086550 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-f765d464-1450-4a9d-80f8-d36153ab41ff admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:10:53.087585 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-f765d464-1450-4a9d-80f8-d36153ab41ff admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jul 26 17:10:53.088008 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Jul 26 17:10:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:10:53.292898 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-689bc3a6-0f2f-4cb8-98a0-78982fedb1e3 admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:10:53.295959 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 17:10:53.295959 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: warnings.warn(msg) Jul 26 17:10:53.298171 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-689bc3a6-0f2f-4cb8-98a0-78982fedb1e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:10:53.298621 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-689bc3a6-0f2f-4cb8-98a0-78982fedb1e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:10:53.299404 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-689bc3a6-0f2f-4cb8-98a0-78982fedb1e3 admin admin] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:10:53.299820 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-689bc3a6-0f2f-4cb8-98a0-78982fedb1e3 admin admin] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:10:53.320069 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-689bc3a6-0f2f-4cb8-98a0-78982fedb1e3 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.088523 Jul 26 17:10:53.320656 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Jul 26 17:10:53 2022] GET /compute/v2.1/os-services => generated 794 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:11:04.778965 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-f765d464-1450-4a9d-80f8-d36153ab41ff admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:11:04.779970 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-f765d464-1450-4a9d-80f8-d36153ab41ff admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 26 17:11:04.780371 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Jul 26 17:11:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:11:05.017140 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writing DB stats nova_cell0:SELECT=4 {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:11:05.017950 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writing DB stats nova_cell1:SELECT=4 {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:11:05.018406 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG dbcounter [-] [103544] Writing DB stats nova_api:SELECT=8 {{(pid=103544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:11:05.085181 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-690e4336-5018-40ee-be39-5198d5096aba admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:11:05.087655 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 17:11:05.087655 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: warnings.warn(msg) Jul 26 17:11:05.088987 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-690e4336-5018-40ee-be39-5198d5096aba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:11:05.089439 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-690e4336-5018-40ee-be39-5198d5096aba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:11:05.090239 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-690e4336-5018-40ee-be39-5198d5096aba admin admin] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:11:05.090662 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-690e4336-5018-40ee-be39-5198d5096aba admin admin] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:11:05.119014 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-690e4336-5018-40ee-be39-5198d5096aba admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.107060 Jul 26 17:11:05.119604 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Jul 26 17:11:05 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:11:06.013428 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: DEBUG nova.api.openstack.wsgi [None req-f765d464-1450-4a9d-80f8-d36153ab41ff admin admin] Calling method '>' {{(pid=103543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:11:06.014915 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: INFO nova.api.openstack.requestlog [None req-f765d464-1450-4a9d-80f8-d36153ab41ff admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 Jul 26 17:11:06.015485 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: [pid: 103543|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Tue Jul 26 17:11:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:11:06.225137 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG nova.api.openstack.wsgi [None req-c329b48b-9cc7-4476-9263-9e9e2c485ee4 admin admin] Calling method '>' {{(pid=103544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:11:06.227991 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 17:11:06.227991 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: warnings.warn(msg) Jul 26 17:11:06.229472 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-c329b48b-9cc7-4476-9263-9e9e2c485ee4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:11:06.230220 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-c329b48b-9cc7-4476-9263-9e9e2c485ee4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:11:06.231258 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-c329b48b-9cc7-4476-9263-9e9e2c485ee4 admin admin] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:11:06.231959 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: DEBUG oslo_concurrency.lockutils [None req-c329b48b-9cc7-4476-9263-9e9e2c485ee4 admin admin] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:11:06.258728 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: INFO nova.api.openstack.requestlog [None req-c329b48b-9cc7-4476-9263-9e9e2c485ee4 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.098739 Jul 26 17:11:06.259373 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: [pid: 103544|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Tue Jul 26 17:11:06 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:12:04.382538 dv-cinder-835384-17-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 17:12:04.383723 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: Tue Jul 26 17:12:04 2022 - graceful shutdown triggered... Jul 26 17:12:04.384298 dv-cinder-835384-17-iscsi devstack@n-api.service[103544]: Gracefully killing worker 2 (pid: 103544)... Jul 26 17:12:04.384662 dv-cinder-835384-17-iscsi devstack@n-api.service[103543]: Gracefully killing worker 1 (pid: 103543)... Jul 26 17:12:05.384921 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: worker 1 buried after 1 seconds Jul 26 17:12:05.384921 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: worker 2 buried after 1 seconds Jul 26 17:12:05.384921 dv-cinder-835384-17-iscsi devstack@n-api.service[103542]: goodbye to uWSGI. Jul 26 17:12:05.386642 dv-cinder-835384-17-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 26 17:12:05.387439 dv-cinder-835384-17-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 17:12:05.391256 dv-cinder-835384-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 17:12:05.404467 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 17:12:05 2022] *** Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: nodename: dv-cinder-835384-17-iscsi Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: machine: x86_64 Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: clock source: unix Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: pcre jit disabled Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: detected number of CPU cores: 4 Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: current working directory: / Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: detected binary path: /usr/bin/uwsgi-core Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: your processes number limit is 47680 Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: your memory page size is 4096 bytes Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: detected max file descriptor number: 2048 Jul 26 17:12:05.408157 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: lock engine: pthread robust mutexes Jul 26 17:12:05.410047 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: thunder lock: enabled Jul 26 17:12:05.410047 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 17:12:05.410047 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 17:12:05.461483 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: Python main interpreter initialized at 0x5570960ff9c0 Jul 26 17:12:05.461483 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: python threads support enabled Jul 26 17:12:05.461483 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: your server socket listen backlog is limited to 100 connections Jul 26 17:12:05.461483 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: your mercy for graceful operations on workers is 90 seconds Jul 26 17:12:05.462118 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 17:12:05.462118 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: *** Operational MODE: preforking *** Jul 26 17:12:05.462445 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: *** uWSGI is running in multiple interpreter mode *** Jul 26 17:12:05.462445 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: spawned uWSGI master process (pid: 118104) Jul 26 17:12:05.462705 dv-cinder-835384-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 17:12:05.471934 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: spawned uWSGI worker 1 (pid: 118121, cores: 1) Jul 26 17:12:05.471934 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: spawned uWSGI worker 2 (pid: 118122, cores: 1) Jul 26 17:12:05.471934 dv-cinder-835384-17-iscsi devstack@n-api.service[118104]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 17:12:06.211926 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 17:12:06.219488 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 17:12:07.434993 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 17:12:07.434993 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: from cryptography.utils import int_from_bytes Jul 26 17:12:07.435773 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 17:12:07.435773 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: from cryptography.utils import int_from_bytes Jul 26 17:12:07.626619 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 17:12:07.626619 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: from cryptography.utils import int_from_bytes Jul 26 17:12:07.627292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 17:12:07.627292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: from cryptography.utils import int_from_bytes Jul 26 17:12:09.952473 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 17:12:09.954080 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 17:12:09.954080 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 17:12:09.954080 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 17:12:09.954080 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 17:12:09.954703 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.954867 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.955089 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.955423 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.955990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.956181 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.956394 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.956719 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.957083 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.957350 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.957672 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.957999 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-17-iscsi {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.958328 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.958817 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.959132 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.959463 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.959771 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.960096 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.960410 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.960930 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.961407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.967373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.967373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.967373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.967373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.967373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.967373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.967373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.967373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.969344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.969344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-17-iscsi {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.969344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.969344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.969344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.969344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.969344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.969344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.970291 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.970291 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.970291 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.970291 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.970291 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.970291 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.970291 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.970291 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.971127 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.971127 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.971127 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.971474 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.971606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.971827 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.972143 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.972472 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.972812 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.973152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.973411 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.973667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.973994 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.974322 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.974644 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.974949 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.975258 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.975562 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.975876 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.976184 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.976493 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.976801 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.977156 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.977471 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.977807 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.978115 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.978437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.978846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.979101 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.979411 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.979766 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.980088 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.980402 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.980725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.981099 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.981386 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.981697 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.982005 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.982331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.982677 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.982987 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.983240 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.983544 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.983853 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.985314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.985314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.985729 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.986257 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.986478 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.986678 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.986944 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.987257 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.987567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.987877 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.988185 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.988495 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.988806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.989152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.989486 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.989810 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.990120 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.990427 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.990738 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.991047 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.991376 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.991684 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.992259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.992594 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.992908 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.993242 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.993570 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.993879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.994186 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.994513 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.994817 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.995124 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.995445 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.995952 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.996118 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.996353 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.996662 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.997096 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.997278 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.997593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.997896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.998199 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.998526 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.998849 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.999166 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:09.999475 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.000018 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.000449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.000877 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.001381 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.001747 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.002071 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.002414 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.002753 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.003078 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.003398 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.003721 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.004055 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.004370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.004685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.005022 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.005355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.005678 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.006015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.006332 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.006655 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.006979 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.007292 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.007613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.007949 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.008276 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.008592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.008937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.009323 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.009639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.009972 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.010305 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.010624 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.010940 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.011470 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.011720 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.011950 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.012230 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.012554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.013016 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.013455 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.013996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.013996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.014400 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.014615 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.014846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.015055 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.015699 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.016041 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.016256 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.016470 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.016789 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.017126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.017437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.017747 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.018062 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.018371 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.018698 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.019040 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.019353 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.019698 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.020008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.020325 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.020639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.020952 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.021284 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.021615 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.021943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.022235 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.022568 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.022880 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.023195 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.023522 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.023870 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.024165 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.024423 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.024747 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.025085 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.025403 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.025720 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.026100 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.026367 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.026653 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.027008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.027346 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.027711 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.027991 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.028303 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.028621 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.028931 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.029272 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.029582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.029889 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.030197 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.030531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.031666 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.031912 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.032242 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.032552 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.032830 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.033161 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.033464 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.033758 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.034067 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.034302 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.034660 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.035099 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.035345 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.035648 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.035972 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.036303 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.036618 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.036940 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.037280 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.037598 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.037914 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.038229 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.038557 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.038873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.039196 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.039509 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.039840 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.040152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.040474 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.040782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.041134 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.041480 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.041843 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.042142 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.042471 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.042787 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.043104 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.043442 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.043737 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.044049 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.044367 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.044688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.045024 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.045348 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.045661 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.045990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.046326 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.047372 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.047832 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.048134 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.048576 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.048924 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.049266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.049588 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.049914 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.050231 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.050546 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.050867 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.051177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.051491 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.051814 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.052140 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.052457 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.052774 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.053111 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.053433 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.053752 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.054068 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.054373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.054694 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.055031 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.055347 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.055676 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.055999 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.056312 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.056621 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.056949 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.057302 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.057655 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.057955 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.058213 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.058576 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.060008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.060008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.060008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.060008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.061010 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.061010 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.061010 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.061685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.061685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.061685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.062781 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.062781 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.062781 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.063689 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.063689 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.063689 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.064506 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.065431 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.065852 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.066637 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.066637 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.067049 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.067435 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.067792 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.068122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.068453 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.068785 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.069160 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.069511 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.069851 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.070209 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.070525 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.071053 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.071323 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.071576 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.071794 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.072050 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.072367 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.072678 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.073240 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.073413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.073629 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.073937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.074252 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.074580 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.074886 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.075317 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.075570 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.075834 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.076150 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.076458 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.076768 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.077107 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.077467 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.077882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.078264 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.078651 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.079008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.079320 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.079632 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.079965 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.080275 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.080585 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.080893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.081300 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.081572 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.081886 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.082204 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.082521 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.082839 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.083156 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.083505 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.083776 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.084424 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.084424 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.084843 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.085034 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.085461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.085639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.085934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.086240 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.086552 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.086864 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.087185 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.087493 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.087797 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.088106 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.088422 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.088749 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.090916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.090916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.090916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.090916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.090916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.090916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.090916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.091937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.091937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.091937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.092357 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.092564 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.092723 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.093041 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.094220 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.094220 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.094996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.095191 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 17:12:10.097782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.098065 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 17:12:10.098321 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.098321 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.098321 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.098321 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.099253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 17:12:10.099495 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.099724 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 17:12:10.099954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.100191 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 17:12:10.100437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.100695 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.100928 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.100928 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.101445 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.101445 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.101871 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.101871 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.102173 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.102173 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.102467 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.102627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.102854 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.103099 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.103316 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.103524 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.103732 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.103732 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.104028 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.104028 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.104312 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.104464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.104608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.104779 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-17-iscsi {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.104949 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.105197 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.105197 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.105197 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.105197 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.105197 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.105197 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.105197 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.106156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.106156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.106156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.106156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.106156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.106156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.106989 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.106989 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.106989 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.106989 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.106989 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.107690 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-17-iscsi {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.107690 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.107985 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.108142 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.108489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.108805 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.109214 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.110226 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.110574 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.110917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.111251 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.111584 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.112021 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.112239 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.112556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.112873 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.113178 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.113351 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.113540 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.113699 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.113890 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.114107 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.114264 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.114419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.114597 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.114750 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.114916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.115074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.115220 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.115382 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.115607 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.115778 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.115937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.116100 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.116258 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.116422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.116572 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.117035 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.117213 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.117432 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.117432 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.117732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.118021 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.118335 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.118652 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.118964 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.119278 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.119591 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.119923 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.120244 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.120576 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.120889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.121382 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.121663 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.121924 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.122283 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.122583 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.122911 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.123222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.123547 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.123878 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.124192 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.124501 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.125360 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.125714 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.126022 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.126263 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.126479 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.126693 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.126904 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.127100 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.127323 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.127542 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.127778 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.127982 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.128182 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.128395 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.128728 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.129108 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.129108 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.129524 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.129730 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.129936 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.129936 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.130358 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.130560 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.130768 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.130768 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.131171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.131701 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.131924 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.131924 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.132359 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.132359 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.132937 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.132937 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.133370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.133606 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.133606 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.133994 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.134207 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.134207 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.134626 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.134852 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.135074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.135074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.135466 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.135672 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.135672 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.136254 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.136450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.136661 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.136869 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.136869 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.137371 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.137601 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.137812 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.138020 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.138020 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.138426 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.138657 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.138850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.139093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.139093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.139651 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.139867 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.140094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.140389 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.140608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.140834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.140834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.141272 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.141522 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.142006 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.142006 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.142407 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.142629 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.143040 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.143259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.143477 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.143477 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.143477 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.144029 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.144176 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 17:12:10.144176 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.144470 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.144673 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.144870 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.145093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.145093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.145403 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.145580 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.145794 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.146023 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.146385 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.146606 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.146606 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.146606 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.147164 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.147334 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.147482 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.147626 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.147775 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.147959 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.148135 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.148352 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.148352 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.148760 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.148993 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.148993 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.148993 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.148993 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.149885 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.150022 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.150022 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.150335 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.150548 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.150757 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.150983 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.151196 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.151400 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.151400 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.151809 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.152302 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.152528 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.152785 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.153299 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.153514 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.153514 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.153931 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.154143 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.154143 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.154626 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.154838 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.154838 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.154838 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.155442 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.155675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.155675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.156769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.157000 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.157234 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.157457 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.157457 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.157457 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.158025 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.158229 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.158418 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.158603 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.158780 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.158959 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.159149 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.159349 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.159529 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.159738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.159738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.160235 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.160431 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.160634 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.160817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.160817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.161273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.161490 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.161695 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.161920 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.161920 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.162547 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.162685 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.162818 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.163008 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.163191 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.163589 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.163589 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.163894 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.164040 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.164188 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.164376 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.164595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.164756 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.164756 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.165032 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.165181 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.165181 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.165181 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.165627 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.165842 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.165842 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.166230 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.166378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.166378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.166771 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.166958 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.166958 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.167346 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.167532 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.167688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.167865 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.167865 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.168129 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.168243 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.168375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.168516 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.168516 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.168797 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.169079 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.169283 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.169497 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.169497 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.169896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.171485 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.171744 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.171916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.171916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.172226 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.172396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.172396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.177400 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.177627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.177859 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.178080 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.178080 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.178503 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.178712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.178930 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.179153 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.179368 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.179572 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.179796 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.179998 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.180238 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.180450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.180450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.180450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.180450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.180450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.180450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.180450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.180450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.182076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.182076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.182076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.182076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.182076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.182076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.182076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.182076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.184883 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.184883 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.184883 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.184883 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.184883 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.184883 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.184883 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.184883 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.186423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.186423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.186423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.186423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.186423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.186423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.186423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.186423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.189164 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.189164 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.189164 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.189164 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.189164 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.190170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.190379 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.190590 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.190786 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.190987 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.191199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.191412 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.192557 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.192557 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.192996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.193230 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.193466 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.193699 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.193699 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.194076 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.194262 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.194464 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.194660 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.194660 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.195059 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.195284 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.195284 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.195284 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.195877 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.196080 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.196274 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.196482 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.196687 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.196687 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.197730 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.197730 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.198124 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.198318 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.198504 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.198713 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.198713 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.199083 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.199274 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.199458 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.199634 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.199634 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.199983 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.200185 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.200185 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.200543 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.200739 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.200927 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.201143 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.201322 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.201515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.201515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.201861 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.202070 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.202253 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.202433 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.202433 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.203648 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.203873 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.204110 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.204332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.204332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.204718 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.204896 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.205107 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.205308 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.205494 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.205676 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.205676 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.206046 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.206234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.206438 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.206619 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.206619 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.206983 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.207729 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.207933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.208124 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.208124 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.208124 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.208659 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.208844 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.209086 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.209334 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.209537 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.209734 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.209734 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.210071 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.210272 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.210450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.210673 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.210673 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.211033 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.211225 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.211426 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.211624 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.211804 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.211994 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.211994 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.212350 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.212527 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.212527 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.212896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.213281 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.213482 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.213701 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.213906 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.214120 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.214120 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.214520 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.214732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.214949 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.215153 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.215153 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.215549 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.215751 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.215962 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.216169 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.216169 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.216551 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.216752 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.216947 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.217269 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.218028 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.218229 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.218229 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.218229 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.218818 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.219038 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.219223 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.219400 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.219400 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.219764 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.219950 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.220142 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.220348 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.220552 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.220743 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.220743 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.221161 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.221341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.221537 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.221720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.221720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.222105 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.222323 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.222323 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.222323 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.222872 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.223072 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.223281 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.223648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.223648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.224017 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.224231 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.224428 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.224605 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.224605 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.224989 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.225216 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.225435 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.225642 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.225642 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.226015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.226201 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.226380 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.226575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.226575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.226980 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.227190 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.227635 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.227635 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.228850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.229145 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.229145 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.229558 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.229785 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.229785 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.229785 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.230349 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.230574 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.230574 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.231004 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.231218 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.231435 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.231664 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.231890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.232114 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.232114 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.233248 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.233465 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.233706 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.234210 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.234210 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.234650 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.234870 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.235095 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.235331 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.235331 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.235331 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.235967 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.236196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.236415 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.236635 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.236854 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.237110 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.237110 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.237507 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.237688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.237868 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.238717 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.238717 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.239141 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.239327 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.239523 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.239725 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.239725 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.240095 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.240286 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.240493 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.240719 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.240719 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.241164 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.241380 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.241380 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.241992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.242207 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.242207 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.242570 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.242775 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.242775 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.243170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.243383 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.243383 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.243766 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.243966 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.243966 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.244562 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.244773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.244952 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.245177 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.245177 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.245547 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.245746 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.245923 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.246109 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.246109 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.246451 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.246629 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.246629 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.246980 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.247165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.247343 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.247530 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.247530 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.247530 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.248064 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.248892 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.248892 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.249321 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.249517 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.250270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.250469 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.250681 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.250888 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.251101 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.251333 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.251551 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.251767 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.251767 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.252136 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.252322 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.252525 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.252703 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.252878 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.253141 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.253141 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.253141 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.253141 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.253141 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.253141 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.254178 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.254364 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.254364 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.254954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.255177 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.255177 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.255539 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.255726 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.255914 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.256093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.256093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.256441 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.256628 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.256806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.257019 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.257019 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.257370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.257565 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.257565 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.257923 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.258114 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.258114 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.258939 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.259285 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.259491 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.259685 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.259685 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.260140 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.260317 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.260491 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.260675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.260870 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.261071 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.261071 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.261449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.261640 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.261837 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.262029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.262029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.262380 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.262556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.262740 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.262935 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.262935 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.263302 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.263481 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.263677 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.263876 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.263876 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.264279 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.264460 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.264460 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.264460 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.265281 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.266030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.266251 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.266458 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.266660 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.266849 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.267036 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.267233 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.267409 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.267594 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.267594 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.267962 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.268155 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.268355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.268534 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.268534 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.269539 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.269741 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.269947 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.270173 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.270173 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.270581 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.270760 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.270956 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.271157 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.271157 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.271544 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.271726 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.271921 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.272116 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.272116 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.272481 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.272667 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.272842 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.273149 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.273149 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.273521 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.273723 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.273931 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.274141 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.274362 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.274581 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.274581 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.274986 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.275216 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.275642 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.275856 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.275856 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.276250 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.276447 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.276447 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.276845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.277082 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.277082 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.277503 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.277715 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.277940 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.278139 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.278351 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.278584 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.278584 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.279507 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.279890 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.280106 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.280322 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.280322 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.280747 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.281029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.281029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.281441 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.281668 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.281869 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.282076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.282270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.282473 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.282473 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.282884 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.283106 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.283315 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.283546 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.283546 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.283957 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.284188 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.284188 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.284594 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.284808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.285042 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.285252 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.285485 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.285916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.285916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.286320 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.286539 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.286539 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.286973 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.287187 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.287187 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.287577 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.287784 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.287784 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.288209 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.288410 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.288605 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.288798 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.288798 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.289767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.290145 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.290355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.290564 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.290774 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.291002 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.291002 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.291404 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.291621 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.291840 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.292063 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.292284 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.292488 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.292488 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.292878 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.293114 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.293318 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.293545 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.293764 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.293976 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.293976 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.294387 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.294614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.294843 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.295052 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.295261 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.295469 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.295667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.295912 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.295912 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.297069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.297296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.297507 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.297703 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.297703 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.298123 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.298340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.298553 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.298766 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.298974 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.299203 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.299203 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.300035 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.300409 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.300409 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.300816 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.301068 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.301068 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.301449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.301649 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.301649 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.302161 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.302382 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.302600 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.302814 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.302814 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.303207 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.303428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.303653 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.303879 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.304093 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.304314 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.304314 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.304741 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.306008 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.306008 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.306619 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.306863 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.307095 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.307318 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.307530 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.307749 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.307749 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.308158 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.308631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.308855 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.309304 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.310302 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.310757 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.310757 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.311157 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.311388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.311600 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.311810 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.312054 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.312295 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.312295 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.312726 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.312949 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.313183 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.313412 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.313412 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.313816 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.314050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.314272 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.314495 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.314705 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.314928 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.314928 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.315346 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.315561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.315561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.315979 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.316201 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.316443 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.316680 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.316680 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.317400 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.317627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.317852 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.318090 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.318296 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.318532 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.318532 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.318937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.319146 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.319366 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.319575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.319793 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.320026 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.320026 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.321204 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.321460 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.321705 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.321946 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.322197 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.322470 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.322729 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.322972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.322972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.323448 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.323688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.323938 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.324194 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.324448 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.324692 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.324939 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.325261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.325261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.325744 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.325744 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.326208 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.326208 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.326660 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.326913 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.327185 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.327625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.328418 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.328648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.328648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.329174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.329378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.329378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.329378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.329962 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.330183 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.330930 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.331289 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.331289 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.331289 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.331289 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.331289 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.331289 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.332473 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.332694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.332899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.333154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.333154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.333154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.333154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.333154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.333154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.333154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.333154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.334926 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.334926 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.334926 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.334926 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.334926 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.334926 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.334926 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.334926 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.336702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.336702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.336702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.336702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.337853 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.338067 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.338067 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.338067 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.338659 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.338863 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.339068 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.339268 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.339268 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.339668 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.339867 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.340064 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.340270 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.340270 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.340823 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.341518 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.341726 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.341927 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.341927 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.342315 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.342516 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.342729 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.342927 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.343135 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.343408 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.343408 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.343798 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.344011 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.344228 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.344437 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.344437 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.344827 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.345094 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.345094 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.345488 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.345694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.345911 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.346113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.346326 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.346526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.346526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.346943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.347139 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.347347 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.347660 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.347660 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.348254 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.348462 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.348672 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.348885 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.348885 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.349333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.349536 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.349772 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.349986 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.349986 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.349986 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.349986 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.349986 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.351108 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.351734 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.351952 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.352155 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.352367 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.352580 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.352809 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.353107 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.353365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.353628 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.353945 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.354213 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.354454 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.354673 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.354918 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.354918 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.355357 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.355580 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.355807 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.356061 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.356280 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.356479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.356680 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.356888 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.357130 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.357357 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.357562 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.357782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.358000 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.358247 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.358631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.358849 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.359602 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.359818 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.360053 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.360292 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.360542 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.360777 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.361078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.361996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.362238 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.362238 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.362687 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.362917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.363176 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.363407 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.363407 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.363842 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.364079 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.364320 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.364564 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.364795 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.364795 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 17:12:10.365292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.365292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.365292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.365292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.365292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.365292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.365292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.365292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.367251 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.367251 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.367251 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.367251 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.367251 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.367251 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.367251 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.367251 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.369093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.369093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.369093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.369093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.369093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.369093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.369093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.369093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.370799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.370799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.370799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.370799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.370799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.370799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.370799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.370799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.373196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.373196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.373196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.373196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.373196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.373196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.373196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.373196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.375511 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.375511 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.375511 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.375511 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.375511 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.375511 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.375511 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.375511 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.377069 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.377069 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.377069 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.377069 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.377069 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.377069 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.377069 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.377069 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.378674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.378674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.378674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.378674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.378674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.378674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.378674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.378674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.380428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.380428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.380428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.380428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.380428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.380428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.380428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.380428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.382738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.382738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.382738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.382738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.382738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.382738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.382738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.382738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.384341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.384341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.384341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.384341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.384341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.384341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.384341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.384341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.385871 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.385871 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.385871 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.385871 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.385871 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.385871 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.385871 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.385871 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.387299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.387299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.387299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.387299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.387299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.387299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.387299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.387299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.388748 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.388748 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 17:12:10.388748 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 17:12:10.417951 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO dbcounter [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] Registered counter for database nova_api Jul 26 17:12:10.446891 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_db.sqlalchemy.engines [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:12:10.457939 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writer thread running {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:12:10.529479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.context [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de7d5e92-8d50-420a-84c5-3da3d0978a49(cell1) {{(pid=118121) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 17:12:10.529761 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO dbcounter [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] Registered counter for database nova_api Jul 26 17:12:10.534709 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:12:10.536511 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:12:10.537486 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:12:10.540434 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:12:10.543989 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO dbcounter [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] Registered counter for database nova_cell0 Jul 26 17:12:10.551689 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO dbcounter [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] Registered counter for database nova_cell1 Jul 26 17:12:10.553399 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_db.sqlalchemy.engines [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:12:10.561980 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_db.sqlalchemy.engines [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:12:10.564191 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_db.sqlalchemy.engines [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:12:10.569880 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writer thread running {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:12:10.571413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writer thread running {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:12:10.577173 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writer thread running {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:12:10.682491 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.context [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de7d5e92-8d50-420a-84c5-3da3d0978a49(cell1) {{(pid=118122) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 17:12:10.689754 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:12:10.693048 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:12:10.694351 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:12:10.697926 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:12:10.701429 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO dbcounter [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] Registered counter for database nova_cell0 Jul 26 17:12:10.709130 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO dbcounter [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] Registered counter for database nova_cell1 Jul 26 17:12:10.723052 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_db.sqlalchemy.engines [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:12:10.725241 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_db.sqlalchemy.engines [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:12:10.739823 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writer thread running {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:12:10.743058 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO dbcounter [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] Registered counter for database nova_cell0 Jul 26 17:12:10.743954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writer thread running {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:12:10.755223 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_db.sqlalchemy.engines [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:12:10.763404 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writer thread running {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:12:10.902656 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO dbcounter [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] Registered counter for database nova_cell0 Jul 26 17:12:10.911176 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_db.sqlalchemy.engines [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 17:12:10.916199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writer thread running {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 17:12:11.212697 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: WARNING keystonemiddleware.auth_token [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 17:12:11.221046 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: WARNING keystonemiddleware.auth_token [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 17:12:11.252280 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: WARNING keystonemiddleware.auth_token [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 17:12:11.260094 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: WARNING keystonemiddleware.auth_token [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 17:12:11.583263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: WARNING keystonemiddleware.auth_token [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 17:12:11.589865 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: WARNING keystonemiddleware.auth_token [None req-3d083737-3e93-45c6-b7e0-207920571b7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 17:12:11.596622 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570960ff9c0 pid: 118121 (default app) Jul 26 17:12:11.631810 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: WARNING keystonemiddleware.auth_token [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 17:12:11.638167 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: WARNING keystonemiddleware.auth_token [None req-93c49b00-0cb6-4a43-a409-9f3f0e89d1e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 17:12:11.643838 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570960ff9c0 pid: 118122 (default app) Jul 26 17:12:55.341556 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:12:55.345326 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:12:55.347295 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:12:55.348528 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:12:56.312602 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-10c29f68-9708-4ac1-b556-7b63f345769c tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Action: 'create', calling method: .version_select at 0x7f6cab2ce940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-776615660"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:12:58.462969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=3 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:12:58.464028 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=3 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:12:58.466354 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=3 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:12:58.478132 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=3 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:12:58.805447 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-10c29f68-9708-4ac1-b556-7b63f345769c tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.479300 Jul 26 17:12:58.807256 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Tue Jul 26 17:12:55 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3484 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 26 17:12:58.830553 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-92c2c0db-7581-4cc9-9697-8887fe748e1a tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab122790>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:12:58.957564 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-92c2c0db-7581-4cc9-9697-8887fe748e1a tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea" status: 200 len: 344 microversion: 2.1 time: 0.137506 Jul 26 17:12:58.958355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2/2] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:12:58 2022] GET /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea => generated 344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:12:59.690615 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-90b360e1-548d-46e7-a0b2-bdbb73db9e0b tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Action: 'create', calling method: .version_select at 0x7f6cab282940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1883111066", "metadata": {"Type": "work"}}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-90b360e1-548d-46e7-a0b2-bdbb73db9e0b tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Request method failure captured: Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 122 Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCa-y-aRMWE1uKQ5ef8B6A_4JRVB_qcz0PUvAwlnFFxl7ZzWaFuOMfb7I3PlUkevl32FhQUcrqAFQ9Q7EEZoSnMnL5pM7pYxVNIiL7ZRJZqhhC146g9kGUzG0BE6bU0jRKUhR3I8dYnQu_YNUmpMhICdsp-iDlsg-L4g5Ppq3fE93o Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 3577acc4ba4c4de2a2503e6ad2163e33 Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-VolumesNegativeTest-106689731 Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:12:59.699064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-VolumesNegativeTest-106689731 Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 3577acc4ba4c4de2a2503e6ad2163e33 Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-VolumesNegativeTest-106689731 Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-VolumesNegativeTest-106689731-project Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: d0c9eafcf5894c4aa8b62102c0307490 Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-VolumesNegativeTest-106689731-project Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1883111066", "metadata": {"Type": "work"}}} Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: Jul 26 17:12:59.700806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1883111066', 'metadata': {'Type': 'work'}}}} Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise error Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:12:59.701824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 17:12:59.703641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 17:12:59.705035 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 17:12:59.705035 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.706984 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-90b360e1-548d-46e7-a0b2-bdbb73db9e0b tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:12:59.708655 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-90b360e1-548d-46e7-a0b2-bdbb73db9e0b tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.265079 Jul 26 17:12:59.709845 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1156 bytes} [Tue Jul 26 17:12:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1268 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 17:12:59.720697 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7a57fd6f-faf6-4808-bf31-1839f441309c tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Action: 'create', calling method: .version_select at 0x7f6cab122dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-161817180", "metadata": {"Type": "work"}}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7a57fd6f-faf6-4808-bf31-1839f441309c tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Request method failure captured: Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 119 Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CCa-y-aRMWE1uKQ5ef8B6A_4JRVB_qcz0PUvAwlnFFxl7ZzWaFuOMfb7I3PlUkevl32FhQUcrqAFQ9Q7EEZoSnMnL5pM7pYxVNIiL7ZRJZqhhC146g9kGUzG0BE6bU0jRKUhR3I8dYnQu_YNUmpMhICdsp-iDlsg-L4g5Ppq3fE93o Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 3577acc4ba4c4de2a2503e6ad2163e33 Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesNegativeTest-106689731 Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:12:59.728498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesNegativeTest-106689731 Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3577acc4ba4c4de2a2503e6ad2163e33 Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesNegativeTest-106689731 Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesNegativeTest-106689731-project Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: d0c9eafcf5894c4aa8b62102c0307490 Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesNegativeTest-106689731-project Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-161817180", "metadata": {"Type": "work"}}} Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: Jul 26 17:12:59.730128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-161817180', 'metadata': {'Type': 'work'}}}} Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise error Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi '0' Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:12:59.730992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 17:12:59.734152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 17:12:59.736389 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 17:12:59.736389 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.737972 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7a57fd6f-faf6-4808-bf31-1839f441309c tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:12:59.739101 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7a57fd6f-faf6-4808-bf31-1839f441309c tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023796 Jul 26 17:12:59.740191 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 3/4] 10.222.0.48 () {60 vars in 1156 bytes} [Tue Jul 26 17:12:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 17:12:59.753193 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9f18f17d-4c85-47c3-af70-8bec97725832 tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Action: 'create', calling method: .version_select at 0x7f6cab2829d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-691417486", "metadata": {"Type": "work"}}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9f18f17d-4c85-47c3-af70-8bec97725832 tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Request method failure captured: Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 118 Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCa-y-aRMWE1uKQ5ef8B6A_4JRVB_qcz0PUvAwlnFFxl7ZzWaFuOMfb7I3PlUkevl32FhQUcrqAFQ9Q7EEZoSnMnL5pM7pYxVNIiL7ZRJZqhhC146g9kGUzG0BE6bU0jRKUhR3I8dYnQu_YNUmpMhICdsp-iDlsg-L4g5Ppq3fE93o Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 3577acc4ba4c4de2a2503e6ad2163e33 Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-VolumesNegativeTest-106689731 Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:12:59.759077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-VolumesNegativeTest-106689731 Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 3577acc4ba4c4de2a2503e6ad2163e33 Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-VolumesNegativeTest-106689731 Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-VolumesNegativeTest-106689731-project Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: d0c9eafcf5894c4aa8b62102c0307490 Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-VolumesNegativeTest-106689731-project Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-691417486", "metadata": {"Type": "work"}}} Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: Jul 26 17:12:59.760392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-691417486', 'metadata': {'Type': 'work'}}}} Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise error Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi '' Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:12:59.761298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 17:12:59.762568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 17:12:59.763701 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 17:12:59.763701 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.765521 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9f18f17d-4c85-47c3-af70-8bec97725832 tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:12:59.766644 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9f18f17d-4c85-47c3-af70-8bec97725832 tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017880 Jul 26 17:12:59.768277 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 2/5] 10.222.0.48 () {60 vars in 1156 bytes} [Tue Jul 26 17:12:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 17:12:59.780980 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b41e2a7e-ca7d-4ac8-a913-a8615bb75a89 tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Calling method '.version_select at 0x7f6cab13b820>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:12:59.819976 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-b41e2a7e-ca7d-4ac8-a913-a8615bb75a89 tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] HTTP exception thrown: Volume tempest-invalid-607747429 could not be found. Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b41e2a7e-ca7d-4ac8-a913-a8615bb75a89 tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Request method failure captured: Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-607747429 HTTP/1.1 Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CCa-y-aRMWE1uKQ5ef8B6A_4JRVB_qcz0PUvAwlnFFxl7ZzWaFuOMfb7I3PlUkevl32FhQUcrqAFQ9Q7EEZoSnMnL5pM7pYxVNIiL7ZRJZqhhC146g9kGUzG0BE6bU0jRKUhR3I8dYnQu_YNUmpMhICdsp-iDlsg-L4g5Ppq3fE93o Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 3577acc4ba4c4de2a2503e6ad2163e33 Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesNegativeTest-106689731 Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:12:59.824641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesNegativeTest-106689731 Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3577acc4ba4c4de2a2503e6ad2163e33 Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesNegativeTest-106689731 Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesNegativeTest-106689731-project Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: d0c9eafcf5894c4aa8b62102c0307490 Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesNegativeTest-106689731-project Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Volume tempest-invalid-607747429 could not be found. Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': 'tempest-invalid-607747429'} Jul 26 17:12:59.826263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-607747429 could not be found. (HTTP 404) (Request-ID: req-454516da-8cab-478a-ac33-4ac85fac07fa) Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:12:59.827595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 17:12:59.828879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-607747429 could not be found. Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:12:59.830194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-607747429 could not be found. Jul 26 17:12:59.831611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.831611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:12:59.831611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.831611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:12:59.831611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:12:59.831611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:12:59.831611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:12:59.831611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:12:59.831611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-607747429 could not be found. Jul 26 17:12:59.831611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:12:59.836021 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b41e2a7e-ca7d-4ac8-a913-a8615bb75a89 tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Returning 404 to user: Volume tempest-invalid-607747429 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:12:59.837318 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b41e2a7e-ca7d-4ac8-a913-a8615bb75a89 tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-607747429" status: 404 len: 98 microversion: 2.1 time: 0.063340 Jul 26 17:12:59.838617 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 4/6] 10.222.0.48 () {58 vars in 1215 bytes} [Tue Jul 26 17:12:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-607747429 => generated 98 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 17:12:59.849741 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1a372c0a-11fb-4c0c-830a-3904e409cfcd tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004748 Jul 26 17:12:59.851050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1140 bytes} [Tue Jul 26 17:12:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 17:12:59.865241 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-669c36b4-1272-4845-bfd6-fc0d1b5483eb tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006810 Jul 26 17:12:59.867698 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1137 bytes} [Tue Jul 26 17:12:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 17:12:59.879540 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0a37c68b-de8a-42b1-b584-4b5c15c7f62c tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Calling method '.version_select at 0x7f6cab13c700>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:12:59.972945 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-28ca90ef-f297-4bbd-9bec-8fb9fbb4727a tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab0e2d30>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:00.085905 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-28ca90ef-f297-4bbd-9bec-8fb9fbb4727a tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea" status: 200 len: 345 microversion: 2.1 time: 0.116817 Jul 26 17:13:00.086648 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 6/9] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:12:59 2022] GET /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea => generated 345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:13:00.109605 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-899991a0-da0e-4fef-ab70-afdffc805c5f tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Action: 'create', calling method: .version_select at 0x7f6cab0e2940>, body: {"snapshot": {"volume_id": "2ca4429a-3d0b-4810-b781-9666f435e3ea", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1529846185"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:00.376088 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-0a37c68b-de8a-42b1-b584-4b5c15c7f62c tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] HTTP exception thrown: Volume df265744-3847-4694-8a67-a47165fd1bb3 could not be found. Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0a37c68b-de8a-42b1-b584-4b5c15c7f62c tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Request method failure captured: Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: DELETE /compute/v2.1/os-volumes/df265744-3847-4694-8a67-a47165fd1bb3 HTTP/1.1 Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCa-y-aRMWE1uKQ5ef8B6A_4JRVB_qcz0PUvAwlnFFxl7ZzWaFuOMfb7I3PlUkevl32FhQUcrqAFQ9Q7EEZoSnMnL5pM7pYxVNIiL7ZRJZqhhC146g9kGUzG0BE6bU0jRKUhR3I8dYnQu_YNUmpMhICdsp-iDlsg-L4g5Ppq3fE93o Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 3577acc4ba4c4de2a2503e6ad2163e33 Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-VolumesNegativeTest-106689731 Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:13:00.388895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-VolumesNegativeTest-106689731 Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 3577acc4ba4c4de2a2503e6ad2163e33 Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-VolumesNegativeTest-106689731 Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-VolumesNegativeTest-106689731-project Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: d0c9eafcf5894c4aa8b62102c0307490 Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-VolumesNegativeTest-106689731-project Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Volume df265744-3847-4694-8a67-a47165fd1bb3 could not be found. Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': 'df265744-3847-4694-8a67-a47165fd1bb3'} Jul 26 17:13:00.391246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df265744-3847-4694-8a67-a47165fd1bb3 could not be found. (HTTP 404) (Request-ID: req-3ecc3a5f-501f-4d49-91d6-b263ccf04dd0) Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:00.392614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 17:13:00.394552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df265744-3847-4694-8a67-a47165fd1bb3 could not be found. Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 17:13:00.398489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:13:00.405037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df265744-3847-4694-8a67-a47165fd1bb3 could not be found. Jul 26 17:13:00.405037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.405037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:00.405037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.405037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:00.405037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:13:00.405037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:13:00.405037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:13:00.405037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:13:00.405037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df265744-3847-4694-8a67-a47165fd1bb3 could not be found. Jul 26 17:13:00.405037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.410786 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0a37c68b-de8a-42b1-b584-4b5c15c7f62c tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Returning 404 to user: Volume df265744-3847-4694-8a67-a47165fd1bb3 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:13:00.417784 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0a37c68b-de8a-42b1-b584-4b5c15c7f62c tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/df265744-3847-4694-8a67-a47165fd1bb3" status: 404 len: 109 microversion: 2.1 time: 0.542694 Jul 26 17:13:00.428660 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 4/10] 10.222.0.48 () {58 vars in 1248 bytes} [Tue Jul 26 17:12:59 2022] DELETE /compute/v2.1/os-volumes/df265744-3847-4694-8a67-a47165fd1bb3 => generated 109 bytes in 556 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:13:00.462401 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c4a5386c-37da-4c1d-bfa1-b92c03ae1def tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Calling method '.version_select at 0x7f6cab070310>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:00.613123 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-c4a5386c-37da-4c1d-bfa1-b92c03ae1def tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] HTTP exception thrown: Volume 5fc9e893-ff27-4366-ad76-e39c230fdd42 could not be found. Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c4a5386c-37da-4c1d-bfa1-b92c03ae1def tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Request method failure captured: Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/os-volumes/5fc9e893-ff27-4366-ad76-e39c230fdd42 HTTP/1.1 Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCa-y-aRMWE1uKQ5ef8B6A_4JRVB_qcz0PUvAwlnFFxl7ZzWaFuOMfb7I3PlUkevl32FhQUcrqAFQ9Q7EEZoSnMnL5pM7pYxVNIiL7ZRJZqhhC146g9kGUzG0BE6bU0jRKUhR3I8dYnQu_YNUmpMhICdsp-iDlsg-L4g5Ppq3fE93o Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 3577acc4ba4c4de2a2503e6ad2163e33 Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-VolumesNegativeTest-106689731 Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:13:00.617683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3577acc4ba4c4de2a2503e6ad2163e33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-VolumesNegativeTest-106689731 Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 3577acc4ba4c4de2a2503e6ad2163e33 Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-VolumesNegativeTest-106689731 Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-VolumesNegativeTest-106689731-project Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: d0c9eafcf5894c4aa8b62102c0307490 Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-VolumesNegativeTest-106689731-project Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Volume 5fc9e893-ff27-4366-ad76-e39c230fdd42 could not be found. Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '5fc9e893-ff27-4366-ad76-e39c230fdd42'} Jul 26 17:13:00.619916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5fc9e893-ff27-4366-ad76-e39c230fdd42 could not be found. (HTTP 404) (Request-ID: req-bc1dc340-f469-4f4e-8ac9-3fa9cb177762) Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:00.621350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 17:13:00.623502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5fc9e893-ff27-4366-ad76-e39c230fdd42 could not be found. Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 17:13:00.631427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5fc9e893-ff27-4366-ad76-e39c230fdd42 could not be found. Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5fc9e893-ff27-4366-ad76-e39c230fdd42 could not be found. Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c4a5386c-37da-4c1d-bfa1-b92c03ae1def tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] Returning 404 to user: Volume 5fc9e893-ff27-4366-ad76-e39c230fdd42 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c4a5386c-37da-4c1d-bfa1-b92c03ae1def tempest-VolumesNegativeTest-106689731 tempest-VolumesNegativeTest-106689731-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5fc9e893-ff27-4366-ad76-e39c230fdd42" status: 404 len: 109 microversion: 2.1 time: 0.182025 Jul 26 17:13:00.633578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 5/11] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:13:00 2022] GET /compute/v2.1/os-volumes/5fc9e893-ff27-4366-ad76-e39c230fdd42 => generated 109 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 17:13:00.826490 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-899991a0-da0e-4fef-ab70-afdffc805c5f tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.725883 Jul 26 17:13:00.828042 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 7/12] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Jul 26 17:13:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:00.885719 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-23d8276c-c0f5-4ef8-86a4-67f2a6b1d3f0 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab164f70>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:00.958657 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-23d8276c-c0f5-4ef8-86a4-67f2a6b1d3f0 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920" status: 200 len: 287 microversion: 2.1 time: 0.122725 Jul 26 17:13:00.959613 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 6/13] 10.222.0.48 () {58 vars in 1251 bytes} [Tue Jul 26 17:13:00 2022] GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:00.979648 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cc14ac7f-2083-40ee-b050-3c1223356faf tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab0c50d0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:01.052629 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cc14ac7f-2083-40ee-b050-3c1223356faf tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.080873 Jul 26 17:13:01.053688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 8/14] 10.222.0.48 () {58 vars in 1140 bytes} [Tue Jul 26 17:13:00 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:01.070705 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f0415c52-2f38-4dcf-89af-b93795aec491 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab0700d0>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:01.143816 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-f0415c52-2f38-4dcf-89af-b93795aec491 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920" status: 200 len: 287 microversion: 2.1 time: 0.077017 Jul 26 17:13:01.144721 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 7/15] 10.222.0.48 () {58 vars in 1251 bytes} [Tue Jul 26 17:13:01 2022] GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:02.161653 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-700f7cf8-a7c9-4d7c-a5f7-239f429584d4 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab13c3a0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:02.312867 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-700f7cf8-a7c9-4d7c-a5f7-239f429584d4 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920" status: 200 len: 287 microversion: 2.1 time: 0.156438 Jul 26 17:13:02.315343 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 9/16] 10.222.0.48 () {58 vars in 1251 bytes} [Tue Jul 26 17:13:02 2022] GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920 => generated 287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:03.330572 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-cc93d3c4-419b-4633-a51f-57d9a418b6a6 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab07e1f0>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:03.381261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-cc93d3c4-419b-4633-a51f-57d9a418b6a6 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920" status: 200 len: 287 microversion: 2.1 time: 0.055117 Jul 26 17:13:03.382187 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 8/17] 10.222.0.48 () {58 vars in 1251 bytes} [Tue Jul 26 17:13:03 2022] GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:04.395808 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b887d562-a4de-4635-babb-c1330c8c14f4 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab0c5790>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:04.465122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b887d562-a4de-4635-babb-c1330c8c14f4 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920" status: 200 len: 288 microversion: 2.1 time: 0.073939 Jul 26 17:13:04.465707 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 10/18] 10.222.0.48 () {58 vars in 1251 bytes} [Tue Jul 26 17:13:04 2022] GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920 => generated 288 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:13:04.477915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-97b70a90-ce84-4dc1-8458-7447067f2f39 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab07e8b0>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:04.622783 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-97b70a90-ce84-4dc1-8458-7447067f2f39 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920" status: 202 len: 0 microversion: 2.1 time: 0.148822 Jul 26 17:13:04.624026 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 9/19] 10.222.0.48 () {58 vars in 1254 bytes} [Tue Jul 26 17:13:04 2022] DELETE /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:13:04.636220 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-57fcc1cd-728c-4465-9855-8ac9a5101922 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab2cea60>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:04.702620 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-57fcc1cd-728c-4465-9855-8ac9a5101922 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920" status: 200 len: 287 microversion: 2.1 time: 0.073120 Jul 26 17:13:04.703479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 11/20] 10.222.0.48 () {58 vars in 1251 bytes} [Tue Jul 26 17:13:04 2022] GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:13:05.716210 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5294cb79-e8bb-4126-8a71-480fcf186625 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab070040>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:05.753203 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-5294cb79-e8bb-4126-8a71-480fcf186625 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] HTTP exception thrown: Snapshot 184d8cb6-596c-4f14-ae94-68564dc08920 could not be found. Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5294cb79-e8bb-4126-8a71-480fcf186625 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Request method failure captured: Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920 HTTP/1.1 Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCXMgq0Yxxf1cCqBN7KcwAesVzQIf5uCWANtKLW7ShmFdbwfe6qIlxc1XYNvFoqqSKPgmoxPjGiAGvJmuLi_-N188Vy_0bD9jxrktkIagZDPE70keeoMw3KMflzwhk-yGyRFVNLl_kSCtycn_16GMlZZFU8O216PUd97ueZwzrspnQ Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 46b665a42ad5484daa4dbd039a519696 Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-528926994 Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:13:05.755827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46b665a42ad5484daa4dbd039a519696"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46b665a42ad5484daa4dbd039a519696"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46b665a42ad5484daa4dbd039a519696"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46b665a42ad5484daa4dbd039a519696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-VolumesSnapshotsTestJSON-528926994 Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 46b665a42ad5484daa4dbd039a519696 Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-528926994 Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-VolumesSnapshotsTestJSON-528926994-project Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: cc57dd5ce53c49999a9847a5240f53e1 Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-VolumesSnapshotsTestJSON-528926994-project Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Snapshot 184d8cb6-596c-4f14-ae94-68564dc08920 could not be found. Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '184d8cb6-596c-4f14-ae94-68564dc08920'} Jul 26 17:13:05.757010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 184d8cb6-596c-4f14-ae94-68564dc08920 could not be found. (HTTP 404) (Request-ID: req-91dee0ef-ced5-4827-b6a9-ffd128539868) Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:05.757735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 17:13:05.758556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 184d8cb6-596c-4f14-ae94-68564dc08920 could not be found. Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 17:13:05.759423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 184d8cb6-596c-4f14-ae94-68564dc08920 could not be found. Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 184d8cb6-596c-4f14-ae94-68564dc08920 could not be found. Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5294cb79-e8bb-4126-8a71-480fcf186625 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Returning 404 to user: Snapshot 184d8cb6-596c-4f14-ae94-68564dc08920 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5294cb79-e8bb-4126-8a71-480fcf186625 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920" status: 404 len: 111 microversion: 2.1 time: 0.046693 Jul 26 17:13:05.761974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 10/21] 10.222.0.48 () {58 vars in 1251 bytes} [Tue Jul 26 17:13:05 2022] GET /compute/v2.1/os-snapshots/184d8cb6-596c-4f14-ae94-68564dc08920 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:13:05.769743 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-508f530b-3cb3-4353-af3e-f8dcbd3921a4 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab13b820>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:05.965284 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-508f530b-3cb3-4353-af3e-f8dcbd3921a4 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea" status: 202 len: 0 microversion: 2.1 time: 0.199965 Jul 26 17:13:05.966507 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 12/22] 10.222.0.48 () {58 vars in 1248 bytes} [Tue Jul 26 17:13:05 2022] DELETE /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:13:05.977580 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ffbd846d-8b3a-490e-8d57-3c127c795e75 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab07ea60>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:06.097629 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ffbd846d-8b3a-490e-8d57-3c127c795e75 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea" status: 200 len: 344 microversion: 2.1 time: 0.125772 Jul 26 17:13:06.113061 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:13:05 2022] GET /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea => generated 344 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:07.116880 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-17e314c0-abed-4215-b603-57acfbbe52f5 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab0e2670>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:07.196355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-17e314c0-abed-4215-b603-57acfbbe52f5 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] HTTP exception thrown: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-17e314c0-abed-4215-b603-57acfbbe52f5 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Request method failure captured: Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea HTTP/1.1 Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CCXMgq0Yxxf1cCqBN7KcwAesVzQIf5uCWANtKLW7ShmFdbwfe6qIlxc1XYNvFoqqSKPgmoxPjGiAGvJmuLi_-N188Vy_0bD9jxrktkIagZDPE70keeoMw3KMflzwhk-yGyRFVNLl_kSCtycn_16GMlZZFU8O216PUd97ueZwzrspnQ Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 46b665a42ad5484daa4dbd039a519696 Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-528926994 Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:13:07.198337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46b665a42ad5484daa4dbd039a519696"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46b665a42ad5484daa4dbd039a519696"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46b665a42ad5484daa4dbd039a519696"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46b665a42ad5484daa4dbd039a519696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesSnapshotsTestJSON-528926994 Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 46b665a42ad5484daa4dbd039a519696 Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-528926994 Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesSnapshotsTestJSON-528926994-project Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: cc57dd5ce53c49999a9847a5240f53e1 Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesSnapshotsTestJSON-528926994-project Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '2ca4429a-3d0b-4810-b781-9666f435e3ea'} Jul 26 17:13:07.199599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. (HTTP 404) (Request-ID: req-1a5a9917-d96e-4b99-96bf-b2a021fcebf6) Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:07.200606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 17:13:07.202007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 17:13:07.203262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-17e314c0-abed-4215-b603-57acfbbe52f5 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Returning 404 to user: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-17e314c0-abed-4215-b603-57acfbbe52f5 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea" status: 404 len: 109 microversion: 2.1 time: 0.090426 Jul 26 17:13:07.204582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 13/24] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:13:07 2022] GET /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:13:07.223919 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d1079d75-1135-44c9-a65b-97f973fce76d tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab070ca0>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:07.325871 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-d1079d75-1135-44c9-a65b-97f973fce76d tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] HTTP exception thrown: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d1079d75-1135-44c9-a65b-97f973fce76d tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Request method failure captured: Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: DELETE /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea HTTP/1.1 Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCXMgq0Yxxf1cCqBN7KcwAesVzQIf5uCWANtKLW7ShmFdbwfe6qIlxc1XYNvFoqqSKPgmoxPjGiAGvJmuLi_-N188Vy_0bD9jxrktkIagZDPE70keeoMw3KMflzwhk-yGyRFVNLl_kSCtycn_16GMlZZFU8O216PUd97ueZwzrspnQ Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 46b665a42ad5484daa4dbd039a519696 Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-528926994 Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:13:07.329057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46b665a42ad5484daa4dbd039a519696"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46b665a42ad5484daa4dbd039a519696"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46b665a42ad5484daa4dbd039a519696"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46b665a42ad5484daa4dbd039a519696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-VolumesSnapshotsTestJSON-528926994 Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 46b665a42ad5484daa4dbd039a519696 Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-528926994 Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-VolumesSnapshotsTestJSON-528926994-project Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: cc57dd5ce53c49999a9847a5240f53e1 Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-VolumesSnapshotsTestJSON-528926994-project Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '2ca4429a-3d0b-4810-b781-9666f435e3ea'} Jul 26 17:13:07.330180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. (HTTP 404) (Request-ID: req-617f404b-5dbc-4cdd-a062-856d4a92a6c2) Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:07.330817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 17:13:07.332171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 17:13:07.333903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:13:07.336156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.336156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.336156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:07.336156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.336156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:07.336156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:13:07.336156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:13:07.336156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:13:07.336156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:13:07.336156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.336156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.338860 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d1079d75-1135-44c9-a65b-97f973fce76d tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Returning 404 to user: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:13:07.339961 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d1079d75-1135-44c9-a65b-97f973fce76d tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea" status: 404 len: 109 microversion: 2.1 time: 0.126375 Jul 26 17:13:07.341111 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 12/25] 10.222.0.48 () {58 vars in 1248 bytes} [Tue Jul 26 17:13:07 2022] DELETE /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:13:07.353351 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6b891e09-196a-420b-aca3-e3fc02328c63 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Calling method '.version_select at 0x7f6cab13bb80>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:07.437895 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-6b891e09-196a-420b-aca3-e3fc02328c63 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] HTTP exception thrown: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6b891e09-196a-420b-aca3-e3fc02328c63 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Request method failure captured: Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea HTTP/1.1 Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CCXMgq0Yxxf1cCqBN7KcwAesVzQIf5uCWANtKLW7ShmFdbwfe6qIlxc1XYNvFoqqSKPgmoxPjGiAGvJmuLi_-N188Vy_0bD9jxrktkIagZDPE70keeoMw3KMflzwhk-yGyRFVNLl_kSCtycn_16GMlZZFU8O216PUd97ueZwzrspnQ Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 46b665a42ad5484daa4dbd039a519696 Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-528926994 Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:13:07.444846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46b665a42ad5484daa4dbd039a519696"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46b665a42ad5484daa4dbd039a519696"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46b665a42ad5484daa4dbd039a519696"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46b665a42ad5484daa4dbd039a519696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesSnapshotsTestJSON-528926994 Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 46b665a42ad5484daa4dbd039a519696 Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-528926994 Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesSnapshotsTestJSON-528926994-project Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: cc57dd5ce53c49999a9847a5240f53e1 Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesSnapshotsTestJSON-528926994-project Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '2ca4429a-3d0b-4810-b781-9666f435e3ea'} Jul 26 17:13:07.446069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. (HTTP 404) (Request-ID: req-7a29a437-ee5f-498e-a987-59bcabac4456) Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:07.446702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 17:13:07.447593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 17:13:07.448567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:13:07.449483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.449483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.449483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:13:07.449483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.449483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:13:07.449483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:13:07.449483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:13:07.449483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:13:07.449483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:13:07.449483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. Jul 26 17:13:07.449483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:13:07.451733 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6b891e09-196a-420b-aca3-e3fc02328c63 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] Returning 404 to user: Volume 2ca4429a-3d0b-4810-b781-9666f435e3ea could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:13:07.457738 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6b891e09-196a-420b-aca3-e3fc02328c63 tempest-VolumesSnapshotsTestJSON-528926994 tempest-VolumesSnapshotsTestJSON-528926994-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea" status: 404 len: 109 microversion: 2.1 time: 0.108813 Jul 26 17:13:07.460579 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 14/26] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:13:07 2022] GET /compute/v2.1/os-volumes/2ca4429a-3d0b-4810-b781-9666f435e3ea => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:13:08.741250 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-886958049", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "networks": [{"uuid": "2a598522-8646-45aa-a32e-50a70bd79858"}]}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:09.073097 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.network.neutron [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] validate_networks() for [('2a598522-8646-45aa-a32e-50a70bd79858', None, None, None, None, None)] {{(pid=118122) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:13:12.957434 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Flavor limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:13:12.958766 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Image limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:13:12.959409 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Flavor pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:13:12.960163 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Image pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:13:12.960731 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:13:12.995257 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:12.995735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:12.996628 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:13.007587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:13.098393 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Getting quotas for project 25df8851ae9b4039a00a9a30366ac922. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:13:13.110931 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Getting quotas for user e7c8648de5544757aa1d91c0878c65d2 and project 25df8851ae9b4039a00a9a30366ac922. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:13:13.126566 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Going to run 1 instances... {{(pid=118122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:13:13.130856 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:13:13.237690 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7175f815-5a7a-4fa7-ba48-29f296496faa tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.137783 Jul 26 17:13:13.238433 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 13/27] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:13:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 5143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:13:13.254527 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-47308e4c-d9cc-454c-b5e3-535e50c2811d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:13.256017 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-47308e4c-d9cc-454c-b5e3-535e50c2811d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:13.692459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-47308e4c-d9cc-454c-b5e3-535e50c2811d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:13.729833 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-47308e4c-d9cc-454c-b5e3-535e50c2811d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1214 microversion: 2.1 time: 0.474951 Jul 26 17:13:13.737084 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 15/28] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:13 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1214 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:14.760992 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9583311a-916b-4d8e-b35d-51c306fd4636 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:14.763244 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9583311a-916b-4d8e-b35d-51c306fd4636 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:15.000877 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9583311a-916b-4d8e-b35d-51c306fd4636 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:15.050734 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9583311a-916b-4d8e-b35d-51c306fd4636 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1214 microversion: 2.1 time: 0.296203 Jul 26 17:13:15.052462 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 14/29] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:14 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:16.080122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fdc251ac-32ff-49ee-8b5d-688dcca650a0 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:16.081394 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fdc251ac-32ff-49ee-8b5d-688dcca650a0 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:16.098972 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fdc251ac-32ff-49ee-8b5d-688dcca650a0 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:16.105507 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fdc251ac-32ff-49ee-8b5d-688dcca650a0 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:16.107122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fdc251ac-32ff-49ee-8b5d-688dcca650a0 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:16.107769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fdc251ac-32ff-49ee-8b5d-688dcca650a0 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:16.546602 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fdc251ac-32ff-49ee-8b5d-688dcca650a0 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:16.573048 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fdc251ac-32ff-49ee-8b5d-688dcca650a0 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1218 microversion: 2.1 time: 0.493330 Jul 26 17:13:16.588432 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 16/30] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:16 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1218 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:17.233767 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-eb402964-8b10-4c20-b449-85a14f1076ba tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: .version_select at 0x7f6caa786a60>, body: {"keypair": {"name": "tempest-keypair-583507972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw/QXVP9W+1Jnhh6aYI4twQCDk7T6hOcO0Vm4dbHCsJt0cTs5GCnHXGVSAKp3co+DI3mW5waQHVSdwukZJNbMVTR75mz81o7iEY3gtW0mC2WNWJ2SBDVfuaTOM+U4MW6Q=="}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:17.330307 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-eb402964-8b10-4c20-b449-85a14f1076ba tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:13:17.346963 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-eb402964-8b10-4c20-b449-85a14f1076ba tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for user c6291932ceb84b03924c0f056f29c2a9 and project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:13:17.503248 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-eb402964-8b10-4c20-b449-85a14f1076ba tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.057295 Jul 26 17:13:17.513882 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 15/31] 10.222.0.48 () {60 vars in 1159 bytes} [Tue Jul 26 17:13:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:13:17.595855 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-10bb8423-ec1c-4eb9-8560-fbecee5dcf6f tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:17.597332 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-10bb8423-ec1c-4eb9-8560-fbecee5dcf6f tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:17.628193 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10bb8423-ec1c-4eb9-8560-fbecee5dcf6f tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:17.629961 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10bb8423-ec1c-4eb9-8560-fbecee5dcf6f tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:17.634558 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10bb8423-ec1c-4eb9-8560-fbecee5dcf6f tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:17.635161 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10bb8423-ec1c-4eb9-8560-fbecee5dcf6f tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:18.143188 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-10bb8423-ec1c-4eb9-8560-fbecee5dcf6f tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:18.203265 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-10bb8423-ec1c-4eb9-8560-fbecee5dcf6f tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1210 microversion: 2.1 time: 0.608018 Jul 26 17:13:18.203917 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 17/32] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:17 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1210 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:19.235444 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-faffb0cb-4a8f-453b-8b52-6d345f59a785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:19.236196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-faffb0cb-4a8f-453b-8b52-6d345f59a785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:19.319970 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-faffb0cb-4a8f-453b-8b52-6d345f59a785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:19.322566 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-faffb0cb-4a8f-453b-8b52-6d345f59a785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:19.327386 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-faffb0cb-4a8f-453b-8b52-6d345f59a785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:19.334887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-faffb0cb-4a8f-453b-8b52-6d345f59a785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:20.669736 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-faffb0cb-4a8f-453b-8b52-6d345f59a785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:20.688586 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-faffb0cb-4a8f-453b-8b52-6d345f59a785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1272 microversion: 2.1 time: 1.462859 Jul 26 17:13:20.691174 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 16/33] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:19 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1272 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:21.711859 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4c195756-d4d7-4b8b-988b-2fb4882d69a6 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:21.716553 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4c195756-d4d7-4b8b-988b-2fb4882d69a6 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:21.776277 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c195756-d4d7-4b8b-988b-2fb4882d69a6 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:21.797124 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c195756-d4d7-4b8b-988b-2fb4882d69a6 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:21.798355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c195756-d4d7-4b8b-988b-2fb4882d69a6 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:21.800839 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c195756-d4d7-4b8b-988b-2fb4882d69a6 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:23.026768 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4c195756-d4d7-4b8b-988b-2fb4882d69a6 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:23.182433 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4c195756-d4d7-4b8b-988b-2fb4882d69a6 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1272 microversion: 2.1 time: 1.457606 Jul 26 17:13:23.183567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 18/34] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:21 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1272 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:24.241283 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4a63e563-9ff9-4f7d-bee3-6ece9a7c76c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:24.248584 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4a63e563-9ff9-4f7d-bee3-6ece9a7c76c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:24.264492 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:24.270376 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4a63e563-9ff9-4f7d-bee3-6ece9a7c76c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:24.275992 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4a63e563-9ff9-4f7d-bee3-6ece9a7c76c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:24.278173 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4a63e563-9ff9-4f7d-bee3-6ece9a7c76c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:24.282548 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4a63e563-9ff9-4f7d-bee3-6ece9a7c76c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:26.418477 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:26.743702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a654fd70-3d86-4470-b086-ce2d29171cf0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Action: 'create', calling method: .version_select at 0x7f6cab13cdc0>, body: {"keypair": {"name": "tempest-keypair-1047868450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaAz/cqh70xv1tXbNWttLZfos77tvnGdFz3JYQvzImNCAleugL4QLq/fNFT6Zt9EaT2928OG67EbihWIabyrhAiP6H2zEGZgmE6nyI4RRk2h/3PBj5K8QaVm70peLzUEA=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:26.927444 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-a654fd70-3d86-4470-b086-ce2d29171cf0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Getting quotas for project 250e4bed3c4c4c9c94a3143b2c6a7533. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:13:26.953242 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-a654fd70-3d86-4470-b086-ce2d29171cf0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Getting quotas for user ab248df5c41d4495b9c9f46ef33c1631 and project 250e4bed3c4c4c9c94a3143b2c6a7533. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:13:27.080428 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a654fd70-3d86-4470-b086-ce2d29171cf0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.667279 Jul 26 17:13:27.081377 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 19/35] 10.222.0.48 () {62 vars in 1200 bytes} [Tue Jul 26 17:13:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 671 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 17:13:27.376184 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=12 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:27.609114 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-33017673", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:27.682017 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4a63e563-9ff9-4f7d-bee3-6ece9a7c76c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:27.697798 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4a63e563-9ff9-4f7d-bee3-6ece9a7c76c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 3.487250 Jul 26 17:13:27.712168 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 17/36] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:24 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 3504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:27.917710 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] validate_networks() for [('0af083cb-d1e4-488d-8d25-6adac66e506d', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:13:28.741543 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b53dd57d-6008-4348-9bfe-69ea5ac3e64a tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:28.744021 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b53dd57d-6008-4348-9bfe-69ea5ac3e64a tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:28.774228 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b53dd57d-6008-4348-9bfe-69ea5ac3e64a tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:28.781129 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b53dd57d-6008-4348-9bfe-69ea5ac3e64a tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:28.798146 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b53dd57d-6008-4348-9bfe-69ea5ac3e64a tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:28.801976 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b53dd57d-6008-4348-9bfe-69ea5ac3e64a tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:30.724406 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-b53dd57d-6008-4348-9bfe-69ea5ac3e64a tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:30.741624 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b53dd57d-6008-4348-9bfe-69ea5ac3e64a tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 2.005683 Jul 26 17:13:30.756807 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 18/37] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:28 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:30.780373 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-535551909", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "734c8f5e-6756-4577-8da6-4e85b95dd0b0"}], "security_groups": [{"name": "tempest-securitygroup--53187990"}], "key_name": "tempest-keypair-583507972", "user_data": "}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:31.635168 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.network.neutron [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] validate_networks() for [('734c8f5e-6756-4577-8da6-4e85b95dd0b0', None, None, None, None, None)] {{(pid=118122) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:13:32.191149 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:13:32.193109 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:13:32.193820 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:13:32.194381 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:13:32.194943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:13:32.213281 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:32.220319 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:32.228094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:32.231951 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:32.355005 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Getting quotas for project 2b8b6c88af94417c840fdafd1fe431b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:13:32.398854 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Getting quotas for user 97115d07acc5464bb7b097039471fee6 and project 2b8b6c88af94417c840fdafd1fe431b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:13:32.480944 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:13:32.501786 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:13:32.807819 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3b186c7a-32ae-4f6d-b876-81c4f8227e91 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.382129 Jul 26 17:13:32.821802 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 20/38] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:13:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 5400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 17:13:32.838520 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-28902eeb-040c-4607-96bc-85a28c00135c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:32.843536 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-28902eeb-040c-4607-96bc-85a28c00135c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:32.859157 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28902eeb-040c-4607-96bc-85a28c00135c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:32.859861 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28902eeb-040c-4607-96bc-85a28c00135c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:32.864032 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28902eeb-040c-4607-96bc-85a28c00135c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:32.864849 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28902eeb-040c-4607-96bc-85a28c00135c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:33.397343 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28902eeb-040c-4607-96bc-85a28c00135c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:33.412390 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-28902eeb-040c-4607-96bc-85a28c00135c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 0.584709 Jul 26 17:13:33.413028 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 21/39] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:32 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:33.892782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d46c2673-fded-4fec-95a5-0a415ae11436 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Action: 'create', calling method: .version_select at 0x7f6caa681940>, body: {"keypair": {"name": "tempest-keypair-390488908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUV2be+RVevUZMcd18B/JBqMKqhAOOQfAO7HOMm2OXstq+s6hiaES8Zm9axOgqt5gqEd+OGJfbXRC+5gTD2QKM4/FM/du3rJKcSmPTOfUP00yCG76FgVkPZlU47Dk0gZQ=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:34.004986 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-d46c2673-fded-4fec-95a5-0a415ae11436 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Getting quotas for project 6f7fbc938d614078b719aa483aa80cd6. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:13:34.022366 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-d46c2673-fded-4fec-95a5-0a415ae11436 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Getting quotas for user 459db7ff580948dc853b9f843700fe3c and project 6f7fbc938d614078b719aa483aa80cd6. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:13:34.086619 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d46c2673-fded-4fec-95a5-0a415ae11436 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.671339 Jul 26 17:13:34.088520 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 22/40] 10.222.0.48 () {60 vars in 1159 bytes} [Tue Jul 26 17:13:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:34.123034 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-34aab18c-4ea4-46f0-802b-e2dc2f0e0d9d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:34.125045 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-34aab18c-4ea4-46f0-802b-e2dc2f0e0d9d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:34.408824 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-34aab18c-4ea4-46f0-802b-e2dc2f0e0d9d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:34.422563 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-34aab18c-4ea4-46f0-802b-e2dc2f0e0d9d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1220 microversion: 2.1 time: 0.330028 Jul 26 17:13:34.428114 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 23/41] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:34 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1220 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:34.967172 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-588e7e10-aab2-4d48-a555-6b0d47231069 req-263dfbd8-2dbc-4686-b083-acc94eee6ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce4766fe-3ad8-492b-a9b0-4dbd07758a75", "tag": "7479245d-123e-46b1-91f6-427bf645d105"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:35.020813 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-588e7e10-aab2-4d48-a555-6b0d47231069 req-263dfbd8-2dbc-4686-b083-acc94eee6ffb service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:35.028801 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-588e7e10-aab2-4d48-a555-6b0d47231069 req-263dfbd8-2dbc-4686-b083-acc94eee6ffb service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:35.127861 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-588e7e10-aab2-4d48-a555-6b0d47231069 req-263dfbd8-2dbc-4686-b083-acc94eee6ffb service nova] Creating event network-changed:7479245d-123e-46b1-91f6-427bf645d105 for instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 on hv-cinder-83538 Jul 26 17:13:35.131802 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-588e7e10-aab2-4d48-a555-6b0d47231069 req-263dfbd8-2dbc-4686-b083-acc94eee6ffb service nova] Acquired lock "compute-rpcapi-router" {{(pid=118121) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 17:13:35.134501 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-470cc4c9-a4f5-41b5-9943-0c996a79cd06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:35.136873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-470cc4c9-a4f5-41b5-9943-0c996a79cd06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:35.142488 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-470cc4c9-a4f5-41b5-9943-0c996a79cd06 None None] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:35.143289 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-470cc4c9-a4f5-41b5-9943-0c996a79cd06 None None] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:35.182310 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.compute.rpcapi [None req-470cc4c9-a4f5-41b5-9943-0c996a79cd06 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 17:13:35.187262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-470cc4c9-a4f5-41b5-9943-0c996a79cd06 None None] Releasing lock "compute-rpcapi-router" {{(pid=118121) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 17:13:35.269613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-470cc4c9-a4f5-41b5-9943-0c996a79cd06 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.837204 Jul 26 17:13:35.270344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 24/42] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:35.286887 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7490d508-0549-4dc0-b2e3-a0af8a6ebd9b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:35.290256 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7490d508-0549-4dc0-b2e3-a0af8a6ebd9b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:35.310109 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7490d508-0549-4dc0-b2e3-a0af8a6ebd9b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:35.311318 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7490d508-0549-4dc0-b2e3-a0af8a6ebd9b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:35.321217 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7490d508-0549-4dc0-b2e3-a0af8a6ebd9b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:35.321217 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7490d508-0549-4dc0-b2e3-a0af8a6ebd9b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:36.596248 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Flavor limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:13:36.596746 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Image limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:13:36.597057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Flavor pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:13:36.597684 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Image pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:13:36.598492 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:13:36.640274 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:36.643916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:36.658799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:36.662543 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:36.820001 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:13:36.870809 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for user c6291932ceb84b03924c0f056f29c2a9 and project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:13:36.931006 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Going to run 1 instances... {{(pid=118122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:13:36.943270 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:13:37.169517 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-57562bb5-fcdd-465b-9412-3c9e385d1499 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 6.410992 Jul 26 17:13:37.189668 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 19/43] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:13:30 2022] POST /compute/v2.1/servers => generated 400 bytes in 6432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:13:37.208785 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1279982718", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:37.394301 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7490d508-0549-4dc0-b2e3-a0af8a6ebd9b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:37.434754 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7490d508-0549-4dc0-b2e3-a0af8a6ebd9b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 2.162830 Jul 26 17:13:37.447295 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 25/44] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:35 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:37.458162 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-46e95003-5e71-4922-a555-9b20333f1aa6 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:37.459951 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.network.neutron [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] validate_networks() for [('0af083cb-d1e4-488d-8d25-6adac66e506d', None, None, None, None, None)] {{(pid=118122) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:13:37.471450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-46e95003-5e71-4922-a555-9b20333f1aa6 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:37.475960 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=5 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:37.839989 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-46e95003-5e71-4922-a555-9b20333f1aa6 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:37.871551 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-46e95003-5e71-4922-a555-9b20333f1aa6 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1240 microversion: 2.1 time: 0.413571 Jul 26 17:13:37.872939 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 26/45] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:37 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1240 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:38.479525 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8db9329c-b40b-45f5-b7f9-815c9ddb736b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:38.481170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8db9329c-b40b-45f5-b7f9-815c9ddb736b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:38.503677 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8db9329c-b40b-45f5-b7f9-815c9ddb736b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:38.503970 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8db9329c-b40b-45f5-b7f9-815c9ddb736b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:38.506011 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8db9329c-b40b-45f5-b7f9-815c9ddb736b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:38.513859 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8db9329c-b40b-45f5-b7f9-815c9ddb736b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:39.439009 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8db9329c-b40b-45f5-b7f9-815c9ddb736b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:39.465209 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8db9329c-b40b-45f5-b7f9-815c9ddb736b tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 0.990082 Jul 26 17:13:39.466144 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 27/46] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:38 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:13:39.472244 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d15ac5b3-828b-4faf-8c0d-0a463cdaf8ec tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:39.474021 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d15ac5b3-828b-4faf-8c0d-0a463cdaf8ec tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:39.490844 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d15ac5b3-828b-4faf-8c0d-0a463cdaf8ec tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:39.506307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d15ac5b3-828b-4faf-8c0d-0a463cdaf8ec tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:39.507411 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d15ac5b3-828b-4faf-8c0d-0a463cdaf8ec tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:39.508110 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d15ac5b3-828b-4faf-8c0d-0a463cdaf8ec tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:39.714127 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Flavor limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:13:39.714627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Image limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:13:39.715029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Flavor pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:13:39.715444 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Image pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:13:39.715860 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:13:39.719154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=7 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:39.750134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:39.765332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:39.768735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:39.777490 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:39.800356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=23 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:39.865372 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Getting quotas for project 2b8b6c88af94417c840fdafd1fe431b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:13:39.879746 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Getting quotas for user 97115d07acc5464bb7b097039471fee6 and project 2b8b6c88af94417c840fdafd1fe431b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:13:39.928070 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Going to run 1 instances... {{(pid=118122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:13:39.939139 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:13:40.043851 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-39d63f38-0662-4f49-a4c9-d583e5425770 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.849428 Jul 26 17:13:40.046592 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 20/47] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:13:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:13:40.064099 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-18e4d6a2-989f-45cd-b08d-b107c7c3d0cc tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:40.069307 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-18e4d6a2-989f-45cd-b08d-b107c7c3d0cc tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:40.080893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d15ac5b3-828b-4faf-8c0d-0a463cdaf8ec tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:40.097767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d15ac5b3-828b-4faf-8c0d-0a463cdaf8ec tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1236 microversion: 2.1 time: 0.625005 Jul 26 17:13:40.109823 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 28/48] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:39 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1236 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:40.208184 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-18e4d6a2-989f-45cd-b08d-b107c7c3d0cc tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:40.224357 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-18e4d6a2-989f-45cd-b08d-b107c7c3d0cc tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1222 microversion: 2.1 time: 0.161175 Jul 26 17:13:40.227072 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 21/49] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:40 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1222 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:13:40.507228 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cf3cd6f3-8d03-4fed-b807-53bd67496b68 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:40.509046 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cf3cd6f3-8d03-4fed-b807-53bd67496b68 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:40.525620 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf3cd6f3-8d03-4fed-b807-53bd67496b68 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:40.526638 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf3cd6f3-8d03-4fed-b807-53bd67496b68 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:40.530119 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf3cd6f3-8d03-4fed-b807-53bd67496b68 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:40.531652 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf3cd6f3-8d03-4fed-b807-53bd67496b68 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:41.035575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1132505784", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "245eeff0-7f98-4a51-8f09-c74191229e59"}], "security_groups": [{"name": "tempest-securitygroup--1445998741"}], "key_name": "tempest-keypair-1047868450", "user_data": "}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:41.570023 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.network.neutron [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] validate_networks() for [('245eeff0-7f98-4a51-8f09-c74191229e59', None, None, None, None, None)] {{(pid=118122) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:13:41.674828 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cf3cd6f3-8d03-4fed-b807-53bd67496b68 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:41.688046 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cf3cd6f3-8d03-4fed-b807-53bd67496b68 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 1.185858 Jul 26 17:13:41.689581 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 29/50] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:40 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:41.697821 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d373aafe-6d89-484c-a4e2-34ead8302f7f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:41.701899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d373aafe-6d89-484c-a4e2-34ead8302f7f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:41.715829 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d373aafe-6d89-484c-a4e2-34ead8302f7f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:41.725756 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d373aafe-6d89-484c-a4e2-34ead8302f7f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:41.727118 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d373aafe-6d89-484c-a4e2-34ead8302f7f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:41.728292 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d373aafe-6d89-484c-a4e2-34ead8302f7f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:41.927334 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d373aafe-6d89-484c-a4e2-34ead8302f7f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:41.951409 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d373aafe-6d89-484c-a4e2-34ead8302f7f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1298 microversion: 2.1 time: 0.259519 Jul 26 17:13:41.959473 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 30/51] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:41 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1298 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:41.986718 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4facc5a2-01e7-4019-99f7-99c2d767de63 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:41.987884 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4facc5a2-01e7-4019-99f7-99c2d767de63 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:42.015675 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4facc5a2-01e7-4019-99f7-99c2d767de63 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:42.018189 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4facc5a2-01e7-4019-99f7-99c2d767de63 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:42.024428 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4facc5a2-01e7-4019-99f7-99c2d767de63 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:42.027723 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4facc5a2-01e7-4019-99f7-99c2d767de63 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:42.424044 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4facc5a2-01e7-4019-99f7-99c2d767de63 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:42.439793 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4facc5a2-01e7-4019-99f7-99c2d767de63 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1274 microversion: 2.1 time: 0.477547 Jul 26 17:13:42.441228 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 31/52] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:41 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1274 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:42.719832 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a0c83a8d-2041-484f-a897-f07390cce4ec tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:42.720519 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a0c83a8d-2041-484f-a897-f07390cce4ec tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:42.742979 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0c83a8d-2041-484f-a897-f07390cce4ec tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:42.743444 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0c83a8d-2041-484f-a897-f07390cce4ec tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:42.744532 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0c83a8d-2041-484f-a897-f07390cce4ec tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:42.745126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0c83a8d-2041-484f-a897-f07390cce4ec tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:44.316467 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Flavor limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:13:44.316986 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Image limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:13:44.317227 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Flavor pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:13:44.318317 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Image pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:13:44.318913 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:13:44.346392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:44.346865 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:44.347710 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:44.348155 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:44.422190 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Getting quotas for project 250e4bed3c4c4c9c94a3143b2c6a7533. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:13:44.428853 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Getting quotas for user ab248df5c41d4495b9c9f46ef33c1631 and project 250e4bed3c4c4c9c94a3143b2c6a7533. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:13:44.465538 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Going to run 1 instances... {{(pid=118122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:13:44.468603 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:13:44.544051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0c83a8d-2041-484f-a897-f07390cce4ec tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:44.567661 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a0c83a8d-2041-484f-a897-f07390cce4ec tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 1.852735 Jul 26 17:13:44.569285 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 32/53] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:42 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:44.582321 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0f66dc1a-2632-430b-9101-fbbfe1d93c0f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:44.585801 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0f66dc1a-2632-430b-9101-fbbfe1d93c0f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:44.588301 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1bef1298-ac5c-42dc-9ee6-975870bfc40a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.560396 Jul 26 17:13:44.597205 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 22/54] 10.222.0.48 () {62 vars in 1188 bytes} [Tue Jul 26 17:13:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 3570 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 17:13:44.612832 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f66dc1a-2632-430b-9101-fbbfe1d93c0f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:44.614208 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-873c0903-5c22-4b27-85e2-a4c281564b4a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:44.615026 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-873c0903-5c22-4b27-85e2-a4c281564b4a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:44.615774 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f66dc1a-2632-430b-9101-fbbfe1d93c0f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:44.617937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f66dc1a-2632-430b-9101-fbbfe1d93c0f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:44.621331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f66dc1a-2632-430b-9101-fbbfe1d93c0f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:44.635783 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-873c0903-5c22-4b27-85e2-a4c281564b4a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:44.643797 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-873c0903-5c22-4b27-85e2-a4c281564b4a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:44.644578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-873c0903-5c22-4b27-85e2-a4c281564b4a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:44.645096 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-873c0903-5c22-4b27-85e2-a4c281564b4a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:44.968740 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0f66dc1a-2632-430b-9101-fbbfe1d93c0f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:44.985110 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-873c0903-5c22-4b27-85e2-a4c281564b4a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:44.986083 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0f66dc1a-2632-430b-9101-fbbfe1d93c0f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1298 microversion: 2.1 time: 0.415386 Jul 26 17:13:44.986887 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 33/55] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:44 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1298 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:45.006719 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0c6688ca-d89d-425b-9898-a9e955e64045 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:45.010065 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0c6688ca-d89d-425b-9898-a9e955e64045 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:45.039442 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-873c0903-5c22-4b27-85e2-a4c281564b4a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1280 microversion: 2.1 time: 0.437063 Jul 26 17:13:45.041387 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 23/56] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:44 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1280 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:45.174538 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=4 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:45.181168 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c6688ca-d89d-425b-9898-a9e955e64045 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:45.198116 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c6688ca-d89d-425b-9898-a9e955e64045 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:45.199929 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c6688ca-d89d-425b-9898-a9e955e64045 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:45.201223 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0c6688ca-d89d-425b-9898-a9e955e64045 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1282 microversion: 2.20 time: 0.198718 Jul 26 17:13:45.202740 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 34/57] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:13:45 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1282 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:13:45.627395 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3dca4c78-baa4-4cc3-835f-ae0ecc979582 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:45.628198 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3dca4c78-baa4-4cc3-835f-ae0ecc979582 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:45.641475 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3dca4c78-baa4-4cc3-835f-ae0ecc979582 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:45.642096 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3dca4c78-baa4-4cc3-835f-ae0ecc979582 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:45.643167 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3dca4c78-baa4-4cc3-835f-ae0ecc979582 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:45.643858 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3dca4c78-baa4-4cc3-835f-ae0ecc979582 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:46.008192 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-059e7b0a-26be-4532-b147-669a912e1b24 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:46.008799 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-059e7b0a-26be-4532-b147-669a912e1b24 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:46.026428 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-059e7b0a-26be-4532-b147-669a912e1b24 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:46.027111 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-059e7b0a-26be-4532-b147-669a912e1b24 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:46.033442 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-059e7b0a-26be-4532-b147-669a912e1b24 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:46.034220 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-059e7b0a-26be-4532-b147-669a912e1b24 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:46.083345 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3dca4c78-baa4-4cc3-835f-ae0ecc979582 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:46.095001 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3dca4c78-baa4-4cc3-835f-ae0ecc979582 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 0.472353 Jul 26 17:13:46.101156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 24/58] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:45 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:46.104158 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=79 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:46.113675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9dd7a8c6-a9da-425d-a009-9a9dcce69eda tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:46.114335 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9dd7a8c6-a9da-425d-a009-9a9dcce69eda tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:46.134049 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9dd7a8c6-a9da-425d-a009-9a9dcce69eda tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:46.134516 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9dd7a8c6-a9da-425d-a009-9a9dcce69eda tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:46.135493 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9dd7a8c6-a9da-425d-a009-9a9dcce69eda tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:46.136081 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9dd7a8c6-a9da-425d-a009-9a9dcce69eda tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:46.445612 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9dd7a8c6-a9da-425d-a009-9a9dcce69eda tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:46.462607 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9dd7a8c6-a9da-425d-a009-9a9dcce69eda tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1322 microversion: 2.1 time: 0.360212 Jul 26 17:13:46.463204 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 25/59] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:46 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:46.481687 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-059e7b0a-26be-4532-b147-669a912e1b24 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:46.495004 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-059e7b0a-26be-4532-b147-669a912e1b24 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 0.490854 Jul 26 17:13:46.510794 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 35/60] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:46 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:46.513698 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5d8a12a9-a8c5-4dc9-b607-0c8d88cde9f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:46.515320 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5d8a12a9-a8c5-4dc9-b607-0c8d88cde9f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:46.534083 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5d8a12a9-a8c5-4dc9-b607-0c8d88cde9f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:46.534897 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5d8a12a9-a8c5-4dc9-b607-0c8d88cde9f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:46.558998 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5d8a12a9-a8c5-4dc9-b607-0c8d88cde9f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:46.560814 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5d8a12a9-a8c5-4dc9-b607-0c8d88cde9f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:46.714724 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5d8a12a9-a8c5-4dc9-b607-0c8d88cde9f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:46.723394 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1062443054", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13ed1e51-7981-4e97-88de-552dbce88f21"}], "security_groups": [{"name": "tempest-securitygroup--1481298185"}], "key_name": "tempest-keypair-390488908", "user_data": "}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:46.727291 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5d8a12a9-a8c5-4dc9-b607-0c8d88cde9f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:46.730613 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5d8a12a9-a8c5-4dc9-b607-0c8d88cde9f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:46.732581 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5d8a12a9-a8c5-4dc9-b607-0c8d88cde9f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1286 microversion: 2.20 time: 0.244375 Jul 26 17:13:46.734946 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 26/61] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:13:46 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1286 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:13:47.010163 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] validate_networks() for [('13ed1e51-7981-4e97-88de-552dbce88f21', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:13:47.122192 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8bdf29db-6090-4b4c-a2b9-5a7923f5c163 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:47.125845 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8bdf29db-6090-4b4c-a2b9-5a7923f5c163 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:47.141599 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8bdf29db-6090-4b4c-a2b9-5a7923f5c163 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:47.142097 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8bdf29db-6090-4b4c-a2b9-5a7923f5c163 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:47.143036 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8bdf29db-6090-4b4c-a2b9-5a7923f5c163 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:47.143361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8bdf29db-6090-4b4c-a2b9-5a7923f5c163 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:47.738210 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8bdf29db-6090-4b4c-a2b9-5a7923f5c163 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:47.754380 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8bdf29db-6090-4b4c-a2b9-5a7923f5c163 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 0.640459 Jul 26 17:13:47.758302 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 27/62] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:47 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:13:47.769760 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-11658350-cca0-425f-8acc-4bf1221b848d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:47.773936 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-11658350-cca0-425f-8acc-4bf1221b848d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:47.783854 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-11658350-cca0-425f-8acc-4bf1221b848d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:47.784935 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-11658350-cca0-425f-8acc-4bf1221b848d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:47.786048 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-11658350-cca0-425f-8acc-4bf1221b848d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:47.786696 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-11658350-cca0-425f-8acc-4bf1221b848d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:48.683640 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:13:48.684166 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:13:48.684551 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:13:48.685718 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:13:48.686866 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:13:48.700337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:48.700784 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:48.702161 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:48.702591 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:48.730553 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-11658350-cca0-425f-8acc-4bf1221b848d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:48.742030 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Getting quotas for project 6f7fbc938d614078b719aa483aa80cd6. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:13:48.746792 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-11658350-cca0-425f-8acc-4bf1221b848d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1322 microversion: 2.1 time: 0.986377 Jul 26 17:13:48.747763 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Getting quotas for user 459db7ff580948dc853b9f843700fe3c and project 6f7fbc938d614078b719aa483aa80cd6. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:13:48.748096 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 28/63] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:47 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1322 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:48.757918 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-430db56b-e1ff-4d37-8409-70093367ab0c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:48.759074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-430db56b-e1ff-4d37-8409-70093367ab0c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:48.765781 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:13:48.767923 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-430db56b-e1ff-4d37-8409-70093367ab0c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:48.768743 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:13:48.769129 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-430db56b-e1ff-4d37-8409-70093367ab0c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:48.770375 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-430db56b-e1ff-4d37-8409-70093367ab0c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:48.771606 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-430db56b-e1ff-4d37-8409-70093367ab0c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:48.878385 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-22d052b8-ff0b-4d8d-b8ba-6ac99e7f4f9f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.167304 Jul 26 17:13:48.879239 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 36/64] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:13:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 2169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 17:13:48.887909 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ce10b64b-4850-4eda-ac9b-de7380ce424b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:48.888871 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ce10b64b-4850-4eda-ac9b-de7380ce424b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:48.907206 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce10b64b-4850-4eda-ac9b-de7380ce424b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:48.907206 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce10b64b-4850-4eda-ac9b-de7380ce424b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:48.908361 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce10b64b-4850-4eda-ac9b-de7380ce424b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:48.908361 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce10b64b-4850-4eda-ac9b-de7380ce424b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:49.142863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ce10b64b-4850-4eda-ac9b-de7380ce424b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:49.158090 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ce10b64b-4850-4eda-ac9b-de7380ce424b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:49.159758 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ce10b64b-4850-4eda-ac9b-de7380ce424b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:49.161007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ce10b64b-4850-4eda-ac9b-de7380ce424b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1340 microversion: 2.20 time: 0.280932 Jul 26 17:13:49.166149 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 37/65] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:13:48 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1340 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:13:49.451518 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-430db56b-e1ff-4d37-8409-70093367ab0c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:49.492780 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-430db56b-e1ff-4d37-8409-70093367ab0c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 0.740454 Jul 26 17:13:49.496845 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 29/66] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:48 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:49.573687 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-5f4e8ae3-b31b-4c37-b899-2f973d3fc467 req-ad5fdf43-88c8-44ba-b2ff-c3e7baaa871a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9254cf15-b0da-432c-81a4-a9b981a7eda1", "tag": "f1aef139-585a-4874-a8d4-8cf0c15bf33e"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:49.607855 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-5f4e8ae3-b31b-4c37-b899-2f973d3fc467 req-ad5fdf43-88c8-44ba-b2ff-c3e7baaa871a service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:49.613983 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-5f4e8ae3-b31b-4c37-b899-2f973d3fc467 req-ad5fdf43-88c8-44ba-b2ff-c3e7baaa871a service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:49.634663 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-5f4e8ae3-b31b-4c37-b899-2f973d3fc467 req-ad5fdf43-88c8-44ba-b2ff-c3e7baaa871a service nova] Creating event network-changed:f1aef139-585a-4874-a8d4-8cf0c15bf33e for instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 on hv-cinder-83538 Jul 26 17:13:49.641525 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-5f4e8ae3-b31b-4c37-b899-2f973d3fc467 req-ad5fdf43-88c8-44ba-b2ff-c3e7baaa871a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.473366 Jul 26 17:13:49.642147 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 38/67] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:49.660008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7bf1df9c-0491-4e03-b6ac-9e32d6f4ee45 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:49.660687 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7bf1df9c-0491-4e03-b6ac-9e32d6f4ee45 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:49.674322 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7bf1df9c-0491-4e03-b6ac-9e32d6f4ee45 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:49.676437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7bf1df9c-0491-4e03-b6ac-9e32d6f4ee45 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:49.677496 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7bf1df9c-0491-4e03-b6ac-9e32d6f4ee45 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:49.678059 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7bf1df9c-0491-4e03-b6ac-9e32d6f4ee45 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:49.745947 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-192a5ad9-21fd-47d8-92c9-a41fbae450e4 req-65bd79be-089a-40ed-8e03-bfbf3d09c737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4766fe-3ad8-492b-a9b0-4dbd07758a75", "name": "network-vif-plugged", "status": "completed", "tag": "7479245d-123e-46b1-91f6-427bf645d105"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:49.763878 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-192a5ad9-21fd-47d8-92c9-a41fbae450e4 req-65bd79be-089a-40ed-8e03-bfbf3d09c737 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:49.766002 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-192a5ad9-21fd-47d8-92c9-a41fbae450e4 req-65bd79be-089a-40ed-8e03-bfbf3d09c737 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:49.793356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-192a5ad9-21fd-47d8-92c9-a41fbae450e4 req-65bd79be-089a-40ed-8e03-bfbf3d09c737 service nova] Creating event network-vif-plugged:7479245d-123e-46b1-91f6-427bf645d105 for instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 on hv-cinder-83538 Jul 26 17:13:49.794385 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-192a5ad9-21fd-47d8-92c9-a41fbae450e4 req-65bd79be-089a-40ed-8e03-bfbf3d09c737 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118122) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 17:13:49.796112 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5df42496-6e4f-4367-bc99-f7a0e59839a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:49.796713 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5df42496-6e4f-4367-bc99-f7a0e59839a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:49.797723 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5df42496-6e4f-4367-bc99-f7a0e59839a2 None None] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:49.798301 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5df42496-6e4f-4367-bc99-f7a0e59839a2 None None] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:49.810402 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.compute.rpcapi [None req-5df42496-6e4f-4367-bc99-f7a0e59839a2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 17:13:49.812087 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5df42496-6e4f-4367-bc99-f7a0e59839a2 None None] Releasing lock "compute-rpcapi-router" {{(pid=118122) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 17:13:49.853532 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5df42496-6e4f-4367-bc99-f7a0e59839a2 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350471 Jul 26 17:13:49.854652 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 30/68] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:49.870257 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b0e95e06-520e-4ea7-a449-3167617b826f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:49.870658 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b0e95e06-520e-4ea7-a449-3167617b826f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:49.880139 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b0e95e06-520e-4ea7-a449-3167617b826f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:49.880653 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b0e95e06-520e-4ea7-a449-3167617b826f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:49.881739 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b0e95e06-520e-4ea7-a449-3167617b826f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:49.882217 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b0e95e06-520e-4ea7-a449-3167617b826f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:49.932518 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7bf1df9c-0491-4e03-b6ac-9e32d6f4ee45 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:49.942449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7bf1df9c-0491-4e03-b6ac-9e32d6f4ee45 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 0.299026 Jul 26 17:13:49.943174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 39/69] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:49 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:49.961480 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1b796950-7a63-4297-9004-beca1d6ac98f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:49.963911 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1b796950-7a63-4297-9004-beca1d6ac98f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:49.987807 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b796950-7a63-4297-9004-beca1d6ac98f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:49.988600 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b796950-7a63-4297-9004-beca1d6ac98f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:49.990137 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b796950-7a63-4297-9004-beca1d6ac98f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:49.991139 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b796950-7a63-4297-9004-beca1d6ac98f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:50.260712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-b0e95e06-520e-4ea7-a449-3167617b826f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:50.272089 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b0e95e06-520e-4ea7-a449-3167617b826f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1241 microversion: 2.1 time: 0.414341 Jul 26 17:13:50.286921 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 31/70] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:49 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1241 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:50.292711 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-278370bc-926f-40f5-8619-91eb05f124b1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:50.293745 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-278370bc-926f-40f5-8619-91eb05f124b1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:50.309893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-278370bc-926f-40f5-8619-91eb05f124b1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:50.310392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-278370bc-926f-40f5-8619-91eb05f124b1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:50.315997 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-278370bc-926f-40f5-8619-91eb05f124b1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:50.317678 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-278370bc-926f-40f5-8619-91eb05f124b1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:50.344742 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1b796950-7a63-4297-9004-beca1d6ac98f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:50.370756 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1b796950-7a63-4297-9004-beca1d6ac98f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1322 microversion: 2.1 time: 0.426224 Jul 26 17:13:50.375627 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 40/71] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:49 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:50.535555 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2dedb8db-17d9-4aaf-9b38-01482eea8328 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:50.536186 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2dedb8db-17d9-4aaf-9b38-01482eea8328 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:50.549832 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dedb8db-17d9-4aaf-9b38-01482eea8328 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:50.550604 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dedb8db-17d9-4aaf-9b38-01482eea8328 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:50.551428 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dedb8db-17d9-4aaf-9b38-01482eea8328 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:50.551954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dedb8db-17d9-4aaf-9b38-01482eea8328 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:50.706445 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-278370bc-926f-40f5-8619-91eb05f124b1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:50.784419 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-278370bc-926f-40f5-8619-91eb05f124b1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:50.794666 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-278370bc-926f-40f5-8619-91eb05f124b1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:50.800342 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-278370bc-926f-40f5-8619-91eb05f124b1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1340 microversion: 2.20 time: 0.511609 Jul 26 17:13:50.802029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 32/72] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:13:50 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1340 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:13:50.876742 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-e9100854-ff2d-44fc-bb8f-61f535eb7e76 req-febab73b-c798-4937-a2cd-0d4a1dcc590a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6013d114-1110-4e9d-91c2-f4979c5630a8", "tag": "6aa02a88-be55-4444-81d7-64bb4a29e88d"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:50.911135 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-e9100854-ff2d-44fc-bb8f-61f535eb7e76 req-febab73b-c798-4937-a2cd-0d4a1dcc590a service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:50.915968 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-e9100854-ff2d-44fc-bb8f-61f535eb7e76 req-febab73b-c798-4937-a2cd-0d4a1dcc590a service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:50.968537 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-e9100854-ff2d-44fc-bb8f-61f535eb7e76 req-febab73b-c798-4937-a2cd-0d4a1dcc590a service nova] Creating event network-changed:6aa02a88-be55-4444-81d7-64bb4a29e88d for instance 6013d114-1110-4e9d-91c2-f4979c5630a8 on hv-cinder-83538 Jul 26 17:13:50.980416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-e9100854-ff2d-44fc-bb8f-61f535eb7e76 req-febab73b-c798-4937-a2cd-0d4a1dcc590a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152215 Jul 26 17:13:50.983422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 33/73] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:51.006995 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-abf22f2d-3118-4cf7-91ce-68780a1f63de tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:51.009340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-abf22f2d-3118-4cf7-91ce-68780a1f63de tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:51.031667 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-abf22f2d-3118-4cf7-91ce-68780a1f63de tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:51.032114 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-abf22f2d-3118-4cf7-91ce-68780a1f63de tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:51.037779 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-abf22f2d-3118-4cf7-91ce-68780a1f63de tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:51.042280 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-abf22f2d-3118-4cf7-91ce-68780a1f63de tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:51.671300 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-abf22f2d-3118-4cf7-91ce-68780a1f63de tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:51.685927 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2dedb8db-17d9-4aaf-9b38-01482eea8328 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:51.728602 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2dedb8db-17d9-4aaf-9b38-01482eea8328 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 1.196604 Jul 26 17:13:51.731077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-abf22f2d-3118-4cf7-91ce-68780a1f63de tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 0.738150 Jul 26 17:13:51.732206 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 41/74] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:50 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:51.735439 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 34/75] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:50 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:51.761789 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6a372ff8-3934-48fb-8d4f-a517a2d5fe01 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:51.766934 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5f0cfcc1-4860-401c-b646-f8444ef05723 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:51.769649 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5f0cfcc1-4860-401c-b646-f8444ef05723 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:51.769891 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6a372ff8-3934-48fb-8d4f-a517a2d5fe01 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:51.799791 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5f0cfcc1-4860-401c-b646-f8444ef05723 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:51.800994 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a372ff8-3934-48fb-8d4f-a517a2d5fe01 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:51.801856 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5f0cfcc1-4860-401c-b646-f8444ef05723 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:51.802791 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a372ff8-3934-48fb-8d4f-a517a2d5fe01 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:51.807078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5f0cfcc1-4860-401c-b646-f8444ef05723 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:51.807549 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5f0cfcc1-4860-401c-b646-f8444ef05723 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:51.817757 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a372ff8-3934-48fb-8d4f-a517a2d5fe01 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:51.818226 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a372ff8-3934-48fb-8d4f-a517a2d5fe01 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:52.105708 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a372ff8-3934-48fb-8d4f-a517a2d5fe01 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:52.117155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6a372ff8-3934-48fb-8d4f-a517a2d5fe01 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1295 microversion: 2.1 time: 0.377940 Jul 26 17:13:52.122103 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 42/76] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:51 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1295 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:52.135414 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e6a49200-839b-4416-b08d-ad26217c3ac5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:52.136375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e6a49200-839b-4416-b08d-ad26217c3ac5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:52.153928 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6a49200-839b-4416-b08d-ad26217c3ac5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:52.160807 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6a49200-839b-4416-b08d-ad26217c3ac5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:52.162334 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6a49200-839b-4416-b08d-ad26217c3ac5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:52.163180 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6a49200-839b-4416-b08d-ad26217c3ac5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:52.562238 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5f0cfcc1-4860-401c-b646-f8444ef05723 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:52.571853 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5f0cfcc1-4860-401c-b646-f8444ef05723 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1322 microversion: 2.1 time: 0.833477 Jul 26 17:13:52.593114 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 35/77] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:51 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1322 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:52.669600 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6a49200-839b-4416-b08d-ad26217c3ac5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:52.682792 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6a49200-839b-4416-b08d-ad26217c3ac5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:52.684502 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6a49200-839b-4416-b08d-ad26217c3ac5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:52.685773 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e6a49200-839b-4416-b08d-ad26217c3ac5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1340 microversion: 2.20 time: 0.562088 Jul 26 17:13:52.691263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 43/78] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:13:52 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1340 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:13:52.756929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-78809c0d-d283-4a2f-8c9b-56503982ebae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:52.761001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-492d4cf5-1c81-4d29-82d6-5e2cd4e72845 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:52.761797 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-492d4cf5-1c81-4d29-82d6-5e2cd4e72845 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:52.764889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-78809c0d-d283-4a2f-8c9b-56503982ebae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:52.783949 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-492d4cf5-1c81-4d29-82d6-5e2cd4e72845 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:52.786316 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-78809c0d-d283-4a2f-8c9b-56503982ebae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:52.786885 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-492d4cf5-1c81-4d29-82d6-5e2cd4e72845 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:52.787658 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-78809c0d-d283-4a2f-8c9b-56503982ebae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:52.788912 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-492d4cf5-1c81-4d29-82d6-5e2cd4e72845 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:52.789969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-78809c0d-d283-4a2f-8c9b-56503982ebae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:52.791374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-492d4cf5-1c81-4d29-82d6-5e2cd4e72845 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:52.792748 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-78809c0d-d283-4a2f-8c9b-56503982ebae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:53.234344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-492d4cf5-1c81-4d29-82d6-5e2cd4e72845 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:53.258427 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-492d4cf5-1c81-4d29-82d6-5e2cd4e72845 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 0.504348 Jul 26 17:13:53.261055 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 44/79] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:52 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:53.292811 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-4939ee13-f515-4f93-b1f1-619c1058569f req-590e6d10-d26a-4c44-ba8c-68d44250e426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20195acb-7356-4e87-a2a8-1ee88cd3e3ea", "tag": "e663e87f-330a-4fa0-96d9-10ce8af7ff1a"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:53.306191 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-4939ee13-f515-4f93-b1f1-619c1058569f req-590e6d10-d26a-4c44-ba8c-68d44250e426 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:53.307208 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-4939ee13-f515-4f93-b1f1-619c1058569f req-590e6d10-d26a-4c44-ba8c-68d44250e426 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:53.331469 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-4939ee13-f515-4f93-b1f1-619c1058569f req-590e6d10-d26a-4c44-ba8c-68d44250e426 service nova] Creating event network-changed:e663e87f-330a-4fa0-96d9-10ce8af7ff1a for instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea on hv-cinder-83538 Jul 26 17:13:53.341536 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-4939ee13-f515-4f93-b1f1-619c1058569f req-590e6d10-d26a-4c44-ba8c-68d44250e426 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078711 Jul 26 17:13:53.345163 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 45/80] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:53.372242 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-648550e6-0c32-497b-a0f9-85e6b9c118c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:53.378632 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-648550e6-0c32-497b-a0f9-85e6b9c118c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:53.401446 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-648550e6-0c32-497b-a0f9-85e6b9c118c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:53.402608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-648550e6-0c32-497b-a0f9-85e6b9c118c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:53.405418 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-648550e6-0c32-497b-a0f9-85e6b9c118c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:53.406555 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-648550e6-0c32-497b-a0f9-85e6b9c118c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:53.589475 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-648550e6-0c32-497b-a0f9-85e6b9c118c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:53.624079 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-648550e6-0c32-497b-a0f9-85e6b9c118c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1295 microversion: 2.1 time: 0.273376 Jul 26 17:13:53.625080 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 46/81] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:53 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1295 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:53.637706 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ee91b9bc-a5c5-4509-bf05-d2d895d667d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:53.637706 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ee91b9bc-a5c5-4509-bf05-d2d895d667d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:53.657278 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee91b9bc-a5c5-4509-bf05-d2d895d667d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:53.661144 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee91b9bc-a5c5-4509-bf05-d2d895d667d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:53.662292 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee91b9bc-a5c5-4509-bf05-d2d895d667d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:53.663801 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee91b9bc-a5c5-4509-bf05-d2d895d667d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:53.759191 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-78809c0d-d283-4a2f-8c9b-56503982ebae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:53.793644 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-78809c0d-d283-4a2f-8c9b-56503982ebae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 1.041675 Jul 26 17:13:53.797717 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 36/82] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:52 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:53.823165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-cfd5c86d-2af7-4d67-8d56-f6ef4ad26536 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:53.824430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-cfd5c86d-2af7-4d67-8d56-f6ef4ad26536 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:53.852313 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cfd5c86d-2af7-4d67-8d56-f6ef4ad26536 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:53.866773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cfd5c86d-2af7-4d67-8d56-f6ef4ad26536 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:53.867915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cfd5c86d-2af7-4d67-8d56-f6ef4ad26536 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:53.868479 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cfd5c86d-2af7-4d67-8d56-f6ef4ad26536 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:54.119858 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-cfd5c86d-2af7-4d67-8d56-f6ef4ad26536 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:54.136573 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-cfd5c86d-2af7-4d67-8d56-f6ef4ad26536 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:54.141967 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-cfd5c86d-2af7-4d67-8d56-f6ef4ad26536 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:54.144196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-cfd5c86d-2af7-4d67-8d56-f6ef4ad26536 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.343946 Jul 26 17:13:54.145918 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 37/83] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:13:53 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:13:54.155728 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-5680f0c7-b5b9-4133-86cc-d9730e7331fa req-233e6824-78bc-40e4-b786-c9fc822f2ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9254cf15-b0da-432c-81a4-a9b981a7eda1", "name": "network-vif-plugged", "status": "completed", "tag": "f1aef139-585a-4874-a8d4-8cf0c15bf33e"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:54.173576 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-5680f0c7-b5b9-4133-86cc-d9730e7331fa req-233e6824-78bc-40e4-b786-c9fc822f2ada service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:54.175288 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-5680f0c7-b5b9-4133-86cc-d9730e7331fa req-233e6824-78bc-40e4-b786-c9fc822f2ada service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:54.206981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-5680f0c7-b5b9-4133-86cc-d9730e7331fa req-233e6824-78bc-40e4-b786-c9fc822f2ada service nova] Creating event network-vif-plugged:f1aef139-585a-4874-a8d4-8cf0c15bf33e for instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 on hv-cinder-83538 Jul 26 17:13:54.215845 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-5680f0c7-b5b9-4133-86cc-d9730e7331fa req-233e6824-78bc-40e4-b786-c9fc822f2ada service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067985 Jul 26 17:13:54.216454 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 38/84] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:54.262013 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ee91b9bc-a5c5-4509-bf05-d2d895d667d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:54.273804 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ee91b9bc-a5c5-4509-bf05-d2d895d667d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1322 microversion: 2.1 time: 0.644264 Jul 26 17:13:54.274622 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 47/85] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:53 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1322 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:54.285609 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-25ae04ad-c90f-489b-8123-6a3a17967594 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:54.287037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-25ae04ad-c90f-489b-8123-6a3a17967594 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:54.294087 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-25ae04ad-c90f-489b-8123-6a3a17967594 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:54.294604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-25ae04ad-c90f-489b-8123-6a3a17967594 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:54.295787 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-25ae04ad-c90f-489b-8123-6a3a17967594 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:54.296218 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-25ae04ad-c90f-489b-8123-6a3a17967594 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:54.460135 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=20 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:54.497157 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-25ae04ad-c90f-489b-8123-6a3a17967594 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:54.513676 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-25ae04ad-c90f-489b-8123-6a3a17967594 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1314 microversion: 2.1 time: 0.232566 Jul 26 17:13:54.515647 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 39/86] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:54 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:54.651861 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7f2bc033-9633-43bb-8648-da6fd29797de tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:54.652872 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7f2bc033-9633-43bb-8648-da6fd29797de tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:54.665612 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f2bc033-9633-43bb-8648-da6fd29797de tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:54.678198 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f2bc033-9633-43bb-8648-da6fd29797de tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:54.679981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f2bc033-9633-43bb-8648-da6fd29797de tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:54.682468 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f2bc033-9633-43bb-8648-da6fd29797de tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:54.836813 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c9216c9e-5e0d-4389-aba1-7c4fd18996a5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:54.845476 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c9216c9e-5e0d-4389-aba1-7c4fd18996a5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:54.879003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c9216c9e-5e0d-4389-aba1-7c4fd18996a5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:54.879802 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c9216c9e-5e0d-4389-aba1-7c4fd18996a5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:54.884511 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c9216c9e-5e0d-4389-aba1-7c4fd18996a5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:54.886155 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c9216c9e-5e0d-4389-aba1-7c4fd18996a5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:55.195837 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7f2bc033-9633-43bb-8648-da6fd29797de tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:55.222065 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7f2bc033-9633-43bb-8648-da6fd29797de tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.573625 Jul 26 17:13:55.223464 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 48/87] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:54 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:55.243290 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b779946c-431e-4d82-9285-7b4c217b59c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:55.246004 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b779946c-431e-4d82-9285-7b4c217b59c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:55.261149 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b779946c-431e-4d82-9285-7b4c217b59c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:55.262287 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b779946c-431e-4d82-9285-7b4c217b59c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:55.264814 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b779946c-431e-4d82-9285-7b4c217b59c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:55.267055 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b779946c-431e-4d82-9285-7b4c217b59c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:55.557140 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c9216c9e-5e0d-4389-aba1-7c4fd18996a5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:55.560649 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=100 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:55.582016 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c9216c9e-5e0d-4389-aba1-7c4fd18996a5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 0.762335 Jul 26 17:13:55.583818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 40/88] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:54 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:55.593202 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1bccb8db-90b2-4b98-8bac-6d24bb44f0a6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:55.594689 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1bccb8db-90b2-4b98-8bac-6d24bb44f0a6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:55.612702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bccb8db-90b2-4b98-8bac-6d24bb44f0a6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:55.614861 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bccb8db-90b2-4b98-8bac-6d24bb44f0a6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:55.617032 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bccb8db-90b2-4b98-8bac-6d24bb44f0a6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:55.618146 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bccb8db-90b2-4b98-8bac-6d24bb44f0a6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:55.708127 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b779946c-431e-4d82-9285-7b4c217b59c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:55.724935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b779946c-431e-4d82-9285-7b4c217b59c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:55.728127 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b779946c-431e-4d82-9285-7b4c217b59c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:55.730410 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b779946c-431e-4d82-9285-7b4c217b59c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.504497 Jul 26 17:13:55.731293 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 49/89] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:13:55 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:13:55.739926 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2487e055-234f-488f-85f2-f8c8de5c60c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:55.741521 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2487e055-234f-488f-85f2-f8c8de5c60c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:55.752270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2487e055-234f-488f-85f2-f8c8de5c60c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:55.753160 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2487e055-234f-488f-85f2-f8c8de5c60c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:55.754386 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2487e055-234f-488f-85f2-f8c8de5c60c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:55.754989 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2487e055-234f-488f-85f2-f8c8de5c60c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:55.974165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1bccb8db-90b2-4b98-8bac-6d24bb44f0a6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:55.995609 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1bccb8db-90b2-4b98-8bac-6d24bb44f0a6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1322 microversion: 2.1 time: 0.408632 Jul 26 17:13:55.997715 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 41/90] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:55 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:56.036771 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2487e055-234f-488f-85f2-f8c8de5c60c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:56.054849 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2487e055-234f-488f-85f2-f8c8de5c60c7 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1501 microversion: 2.1 time: 0.321332 Jul 26 17:13:56.056430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 50/91] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:55 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1501 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:56.267709 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-52c30aad-35d7-4f90-9b55-42ef5a5fe0fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:56.268861 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-52c30aad-35d7-4f90-9b55-42ef5a5fe0fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:56.294212 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-52c30aad-35d7-4f90-9b55-42ef5a5fe0fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:56.298675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-52c30aad-35d7-4f90-9b55-42ef5a5fe0fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:56.311023 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-52c30aad-35d7-4f90-9b55-42ef5a5fe0fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:56.311023 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-52c30aad-35d7-4f90-9b55-42ef5a5fe0fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:56.626332 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c3c6bf00-739e-4a88-a963-cf06ecf26d9c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:56.628772 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c3c6bf00-739e-4a88-a963-cf06ecf26d9c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:56.642744 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3c6bf00-739e-4a88-a963-cf06ecf26d9c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:56.644037 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3c6bf00-739e-4a88-a963-cf06ecf26d9c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:56.645965 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3c6bf00-739e-4a88-a963-cf06ecf26d9c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:56.657716 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3c6bf00-739e-4a88-a963-cf06ecf26d9c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:56.671992 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-52c30aad-35d7-4f90-9b55-42ef5a5fe0fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:56.683745 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-52c30aad-35d7-4f90-9b55-42ef5a5fe0fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.425143 Jul 26 17:13:56.685040 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 42/92] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:56 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:56.761977 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-afbb74e3-cefc-445f-9399-e60fc39bcb5e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:56.775187 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-afbb74e3-cefc-445f-9399-e60fc39bcb5e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:56.797774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-afbb74e3-cefc-445f-9399-e60fc39bcb5e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:56.798231 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-afbb74e3-cefc-445f-9399-e60fc39bcb5e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:56.799033 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-afbb74e3-cefc-445f-9399-e60fc39bcb5e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:56.799474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-afbb74e3-cefc-445f-9399-e60fc39bcb5e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:57.042762 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c3c6bf00-739e-4a88-a963-cf06ecf26d9c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:57.064481 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c3c6bf00-739e-4a88-a963-cf06ecf26d9c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 0.449437 Jul 26 17:13:57.075826 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 51/93] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:56 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:57.095281 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-885f0ecc-2cd2-4d57-88d8-0982d7a30f13 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:57.095281 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-885f0ecc-2cd2-4d57-88d8-0982d7a30f13 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:57.130549 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-885f0ecc-2cd2-4d57-88d8-0982d7a30f13 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:57.140899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-885f0ecc-2cd2-4d57-88d8-0982d7a30f13 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:57.144101 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-885f0ecc-2cd2-4d57-88d8-0982d7a30f13 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:57.152941 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-885f0ecc-2cd2-4d57-88d8-0982d7a30f13 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:57.297194 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-afbb74e3-cefc-445f-9399-e60fc39bcb5e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:57.312337 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-afbb74e3-cefc-445f-9399-e60fc39bcb5e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:57.315422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-afbb74e3-cefc-445f-9399-e60fc39bcb5e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:57.317657 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-afbb74e3-cefc-445f-9399-e60fc39bcb5e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.566281 Jul 26 17:13:57.318697 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 43/94] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:13:56 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:13:57.341526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-3fdd2e17-507a-4df2-b9c8-b14e825ebc1a req-f22604a7-af41-47cd-8cea-58507b653f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c7d66fd-65f0-4c03-8f1e-93d1ec23d411", "tag": "5a304d69-32d1-40aa-b33c-fe4e3d47a965"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:57.372593 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-3fdd2e17-507a-4df2-b9c8-b14e825ebc1a req-f22604a7-af41-47cd-8cea-58507b653f87 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:57.373634 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-3fdd2e17-507a-4df2-b9c8-b14e825ebc1a req-f22604a7-af41-47cd-8cea-58507b653f87 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:57.401135 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-3fdd2e17-507a-4df2-b9c8-b14e825ebc1a req-f22604a7-af41-47cd-8cea-58507b653f87 service nova] Creating event network-changed:5a304d69-32d1-40aa-b33c-fe4e3d47a965 for instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 on hv-cinder-83538 Jul 26 17:13:57.418106 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-3fdd2e17-507a-4df2-b9c8-b14e825ebc1a req-f22604a7-af41-47cd-8cea-58507b653f87 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090891 Jul 26 17:13:57.419169 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 44/95] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:13:57.491413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-885f0ecc-2cd2-4d57-88d8-0982d7a30f13 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:57.505856 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-885f0ecc-2cd2-4d57-88d8-0982d7a30f13 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1322 microversion: 2.1 time: 0.427670 Jul 26 17:13:57.506789 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 52/96] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:57 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:57.727463 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3bf39995-0d02-424c-84f8-5a7ffad6b92f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:57.728263 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3bf39995-0d02-424c-84f8-5a7ffad6b92f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:57.735671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3bf39995-0d02-424c-84f8-5a7ffad6b92f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:57.736318 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3bf39995-0d02-424c-84f8-5a7ffad6b92f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:57.737372 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3bf39995-0d02-424c-84f8-5a7ffad6b92f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:57.737841 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3bf39995-0d02-424c-84f8-5a7ffad6b92f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:57.934681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3bf39995-0d02-424c-84f8-5a7ffad6b92f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:57.969490 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3bf39995-0d02-424c-84f8-5a7ffad6b92f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.241904 Jul 26 17:13:57.974053 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 45/97] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:57 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:13:58.101995 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4acc7ada-b4b6-4c12-9faa-d830d94e008b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:58.102933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4acc7ada-b4b6-4c12-9faa-d830d94e008b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:58.120177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4acc7ada-b4b6-4c12-9faa-d830d94e008b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:58.121017 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4acc7ada-b4b6-4c12-9faa-d830d94e008b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:58.122722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4acc7ada-b4b6-4c12-9faa-d830d94e008b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:58.141549 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4acc7ada-b4b6-4c12-9faa-d830d94e008b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:58.366532 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5429506b-7324-4086-b778-8d184c096c4d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:58.379967 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5429506b-7324-4086-b778-8d184c096c4d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:58.423370 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5429506b-7324-4086-b778-8d184c096c4d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:58.424553 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5429506b-7324-4086-b778-8d184c096c4d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:58.430680 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5429506b-7324-4086-b778-8d184c096c4d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:58.431776 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5429506b-7324-4086-b778-8d184c096c4d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:58.590408 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4acc7ada-b4b6-4c12-9faa-d830d94e008b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:58.592871 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:58.607117 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4acc7ada-b4b6-4c12-9faa-d830d94e008b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 0.511189 Jul 26 17:13:58.611641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 53/98] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:58 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:58.624682 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2787f907-253c-48fb-88a5-8552f584f415 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:58.627570 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2787f907-253c-48fb-88a5-8552f584f415 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:58.643811 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2787f907-253c-48fb-88a5-8552f584f415 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:58.644578 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2787f907-253c-48fb-88a5-8552f584f415 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:58.645582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2787f907-253c-48fb-88a5-8552f584f415 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:58.647786 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2787f907-253c-48fb-88a5-8552f584f415 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:58.727434 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:58.761212 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=26 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:13:58.933682 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5429506b-7324-4086-b778-8d184c096c4d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:58.949323 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5429506b-7324-4086-b778-8d184c096c4d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:58.951385 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5429506b-7324-4086-b778-8d184c096c4d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:58.953079 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5429506b-7324-4086-b778-8d184c096c4d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.612837 Jul 26 17:13:58.966789 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 46/99] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:13:58 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:13:59.018333 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1b36dfa6-3168-4ddf-9e90-5489782736c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:59.020755 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1b36dfa6-3168-4ddf-9e90-5489782736c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:59.042013 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b36dfa6-3168-4ddf-9e90-5489782736c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:59.045916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b36dfa6-3168-4ddf-9e90-5489782736c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:59.049348 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b36dfa6-3168-4ddf-9e90-5489782736c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:59.053412 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b36dfa6-3168-4ddf-9e90-5489782736c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:59.267685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2787f907-253c-48fb-88a5-8552f584f415 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:59.286815 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1b36dfa6-3168-4ddf-9e90-5489782736c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:13:59.287995 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2787f907-253c-48fb-88a5-8552f584f415 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1322 microversion: 2.1 time: 0.674145 Jul 26 17:13:59.289210 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 54/100] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:58 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1322 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:13:59.300643 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-649b796e-b8ed-4cb4-bfb9-7cf657555000 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d6ad6aa-a4c8-475d-a2a1-711f01c1eff1"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:13:59.305450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-649b796e-b8ed-4cb4-bfb9-7cf657555000 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:59.309840 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1b36dfa6-3168-4ddf-9e90-5489782736c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.297992 Jul 26 17:13:59.319911 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-649b796e-b8ed-4cb4-bfb9-7cf657555000 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:59.320698 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-649b796e-b8ed-4cb4-bfb9-7cf657555000 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:59.322177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-649b796e-b8ed-4cb4-bfb9-7cf657555000 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:59.323265 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-649b796e-b8ed-4cb4-bfb9-7cf657555000 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:59.325178 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 47/101] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:59 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:13:59.633737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-53cc9723-b8f1-427a-b7f8-29348fb6ae5d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:13:59.634390 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-53cc9723-b8f1-427a-b7f8-29348fb6ae5d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:13:59.643453 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-53cc9723-b8f1-427a-b7f8-29348fb6ae5d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:59.643922 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-53cc9723-b8f1-427a-b7f8-29348fb6ae5d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:59.644730 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-53cc9723-b8f1-427a-b7f8-29348fb6ae5d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:13:59.645209 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-53cc9723-b8f1-427a-b7f8-29348fb6ae5d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:13:59.823074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=8 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:00.477862 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-53cc9723-b8f1-427a-b7f8-29348fb6ae5d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:00.489535 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-53cc9723-b8f1-427a-b7f8-29348fb6ae5d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 0.857093 Jul 26 17:14:00.493070 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 48/102] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:13:59 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:00.501670 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c653ac81-5af8-4d67-aad5-ffb0071b4263 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:00.502504 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c653ac81-5af8-4d67-aad5-ffb0071b4263 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:00.509152 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c653ac81-5af8-4d67-aad5-ffb0071b4263 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:00.510041 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c653ac81-5af8-4d67-aad5-ffb0071b4263 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:00.515412 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c653ac81-5af8-4d67-aad5-ffb0071b4263 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:00.516277 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c653ac81-5af8-4d67-aad5-ffb0071b4263 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:00.610466 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-649b796e-b8ed-4cb4-bfb9-7cf657555000 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "POST /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.318417 Jul 26 17:14:00.612738 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 55/103] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:13:59 2022] POST /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75/os-volume_attachments => generated 194 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:00.625265 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e6eec384-04f1-433e-b568-4f76f8e4faad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:00.627360 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e6eec384-04f1-433e-b568-4f76f8e4faad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:00.643866 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6eec384-04f1-433e-b568-4f76f8e4faad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:00.644765 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6eec384-04f1-433e-b568-4f76f8e4faad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:00.647489 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6eec384-04f1-433e-b568-4f76f8e4faad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:00.648256 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6eec384-04f1-433e-b568-4f76f8e4faad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:00.983652 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6eec384-04f1-433e-b568-4f76f8e4faad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:01.005852 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e6eec384-04f1-433e-b568-4f76f8e4faad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1322 microversion: 2.1 time: 0.389556 Jul 26 17:14:01.030450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 56/104] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:00 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:01.046602 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-66312161-d10d-41e5-8ddc-a494cd7047a0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:01.048767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-66312161-d10d-41e5-8ddc-a494cd7047a0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:01.065959 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-66312161-d10d-41e5-8ddc-a494cd7047a0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:01.069125 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-66312161-d10d-41e5-8ddc-a494cd7047a0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:01.070176 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-66312161-d10d-41e5-8ddc-a494cd7047a0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:01.073325 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-66312161-d10d-41e5-8ddc-a494cd7047a0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:01.395480 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c653ac81-5af8-4d67-aad5-ffb0071b4263 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:01.427344 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c653ac81-5af8-4d67-aad5-ffb0071b4263 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:01.464137 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c653ac81-5af8-4d67-aad5-ffb0071b4263 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:01.474589 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c653ac81-5af8-4d67-aad5-ffb0071b4263 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.979163 Jul 26 17:14:01.478111 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 49/105] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:14:00 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:14:01.500436 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-03e5be0b-24b5-4fa1-8bc5-6078c2c3b871 req-3f248f46-3d98-44c3-8387-2a729e19e87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2799ba4-de59-4849-85e7-d0aaf12578e1", "tag": "046c2444-d052-4814-b962-6109cd25ef6e"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:01.531797 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-03e5be0b-24b5-4fa1-8bc5-6078c2c3b871 req-3f248f46-3d98-44c3-8387-2a729e19e87c service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:01.532470 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-03e5be0b-24b5-4fa1-8bc5-6078c2c3b871 req-3f248f46-3d98-44c3-8387-2a729e19e87c service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:01.549032 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-03e5be0b-24b5-4fa1-8bc5-6078c2c3b871 req-3f248f46-3d98-44c3-8387-2a729e19e87c service nova] Creating event network-changed:046c2444-d052-4814-b962-6109cd25ef6e for instance e2799ba4-de59-4849-85e7-d0aaf12578e1 on hv-cinder-83538 Jul 26 17:14:01.555225 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-03e5be0b-24b5-4fa1-8bc5-6078c2c3b871 req-3f248f46-3d98-44c3-8387-2a729e19e87c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070843 Jul 26 17:14:01.555867 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 50/106] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:01.562070 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2ef3cac5-24e2-49c0-81ea-c823e4b3242c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:01.563029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2ef3cac5-24e2-49c0-81ea-c823e4b3242c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:01.573710 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2ef3cac5-24e2-49c0-81ea-c823e4b3242c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:01.574257 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2ef3cac5-24e2-49c0-81ea-c823e4b3242c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:01.575103 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2ef3cac5-24e2-49c0-81ea-c823e4b3242c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:01.575548 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2ef3cac5-24e2-49c0-81ea-c823e4b3242c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:01.720512 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-66312161-d10d-41e5-8ddc-a494cd7047a0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:01.732281 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-66312161-d10d-41e5-8ddc-a494cd7047a0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.693575 Jul 26 17:14:01.751363 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 57/107] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:01 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:01.906365 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-2ef3cac5-24e2-49c0-81ea-c823e4b3242c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:01.916219 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2ef3cac5-24e2-49c0-81ea-c823e4b3242c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 0.358930 Jul 26 17:14:01.917847 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 51/108] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:01 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:01.938387 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-b496ae28-ffed-4209-ba4e-53049157df1a req-ea492896-31a1-44c5-8141-a15abc2ed84b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6013d114-1110-4e9d-91c2-f4979c5630a8", "name": "network-vif-plugged", "status": "completed", "tag": "6aa02a88-be55-4444-81d7-64bb4a29e88d"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:01.957447 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-b496ae28-ffed-4209-ba4e-53049157df1a req-ea492896-31a1-44c5-8141-a15abc2ed84b service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:01.960715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-b496ae28-ffed-4209-ba4e-53049157df1a req-ea492896-31a1-44c5-8141-a15abc2ed84b service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:01.988376 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-b496ae28-ffed-4209-ba4e-53049157df1a req-ea492896-31a1-44c5-8141-a15abc2ed84b service nova] Creating event network-vif-plugged:6aa02a88-be55-4444-81d7-64bb4a29e88d for instance 6013d114-1110-4e9d-91c2-f4979c5630a8 on hv-cinder-83538 Jul 26 17:14:02.005201 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-b496ae28-ffed-4209-ba4e-53049157df1a req-ea492896-31a1-44c5-8141-a15abc2ed84b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071590 Jul 26 17:14:02.008692 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 58/109] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:02.032293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2b4a4c0f-b452-4364-b79e-fdefb95d7bb5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:02.033572 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2b4a4c0f-b452-4364-b79e-fdefb95d7bb5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:02.042229 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2b4a4c0f-b452-4364-b79e-fdefb95d7bb5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:02.042758 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2b4a4c0f-b452-4364-b79e-fdefb95d7bb5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:02.043773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2b4a4c0f-b452-4364-b79e-fdefb95d7bb5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:02.044403 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2b4a4c0f-b452-4364-b79e-fdefb95d7bb5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:02.554956 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b7b9de3d-6398-41b8-a70c-630c9d2a2def tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:02.563436 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b7b9de3d-6398-41b8-a70c-630c9d2a2def tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:02.569544 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-2b4a4c0f-b452-4364-b79e-fdefb95d7bb5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:02.585775 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2b4a4c0f-b452-4364-b79e-fdefb95d7bb5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1322 microversion: 2.1 time: 0.558247 Jul 26 17:14:02.586577 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 52/110] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:02 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:02.605549 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7b9de3d-6398-41b8-a70c-630c9d2a2def tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:02.606859 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7b9de3d-6398-41b8-a70c-630c9d2a2def tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:02.614546 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7b9de3d-6398-41b8-a70c-630c9d2a2def tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:02.615356 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7b9de3d-6398-41b8-a70c-630c9d2a2def tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:02.759241 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-47f0d49f-a49a-41a1-b4e6-6eaf565337ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:02.760228 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-47f0d49f-a49a-41a1-b4e6-6eaf565337ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:02.774629 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-47f0d49f-a49a-41a1-b4e6-6eaf565337ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:02.775581 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-47f0d49f-a49a-41a1-b4e6-6eaf565337ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:02.784824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-47f0d49f-a49a-41a1-b4e6-6eaf565337ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:02.785578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-47f0d49f-a49a-41a1-b4e6-6eaf565337ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:03.151870 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b7b9de3d-6398-41b8-a70c-630c9d2a2def tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:03.174262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b7b9de3d-6398-41b8-a70c-630c9d2a2def tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:03.179580 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b7b9de3d-6398-41b8-a70c-630c9d2a2def tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:03.182700 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b7b9de3d-6398-41b8-a70c-630c9d2a2def tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.661566 Jul 26 17:14:03.184630 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 59/111] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:14:02 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:14:03.194337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-52fcda2d-c5f9-4b53-a47d-0d276ea94b29 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:03.196898 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-52fcda2d-c5f9-4b53-a47d-0d276ea94b29 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:03.214720 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52fcda2d-c5f9-4b53-a47d-0d276ea94b29 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:03.216212 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52fcda2d-c5f9-4b53-a47d-0d276ea94b29 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:03.218711 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52fcda2d-c5f9-4b53-a47d-0d276ea94b29 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:03.219185 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52fcda2d-c5f9-4b53-a47d-0d276ea94b29 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:03.472879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-52fcda2d-c5f9-4b53-a47d-0d276ea94b29 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:03.485769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-52fcda2d-c5f9-4b53-a47d-0d276ea94b29 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 0.299270 Jul 26 17:14:03.486858 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 60/112] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:03 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:03.558306 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-47f0d49f-a49a-41a1-b4e6-6eaf565337ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:03.587018 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-47f0d49f-a49a-41a1-b4e6-6eaf565337ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.832037 Jul 26 17:14:03.591529 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 53/113] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:02 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:03.613576 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cd460011-c964-4327-8dc8-e06d3c3aa2c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:03.614628 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cd460011-c964-4327-8dc8-e06d3c3aa2c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:03.631012 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd460011-c964-4327-8dc8-e06d3c3aa2c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:03.633693 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd460011-c964-4327-8dc8-e06d3c3aa2c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:03.635610 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd460011-c964-4327-8dc8-e06d3c3aa2c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:03.637281 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd460011-c964-4327-8dc8-e06d3c3aa2c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:03.976573 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cd460011-c964-4327-8dc8-e06d3c3aa2c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:03.990216 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cd460011-c964-4327-8dc8-e06d3c3aa2c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1322 microversion: 2.1 time: 0.380881 Jul 26 17:14:03.992656 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 61/114] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:03 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:04.137737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-38084499-0e1f-4387-81a7-d4e79c7c7396 req-31b0c1fa-5d90-4496-8ce7-e60b1f323a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20195acb-7356-4e87-a2a8-1ee88cd3e3ea", "name": "network-vif-plugged", "status": "completed", "tag": "e663e87f-330a-4fa0-96d9-10ce8af7ff1a"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:04.156104 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-38084499-0e1f-4387-81a7-d4e79c7c7396 req-31b0c1fa-5d90-4496-8ce7-e60b1f323a39 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:04.157491 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-38084499-0e1f-4387-81a7-d4e79c7c7396 req-31b0c1fa-5d90-4496-8ce7-e60b1f323a39 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:04.181082 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-38084499-0e1f-4387-81a7-d4e79c7c7396 req-31b0c1fa-5d90-4496-8ce7-e60b1f323a39 service nova] Creating event network-vif-plugged:e663e87f-330a-4fa0-96d9-10ce8af7ff1a for instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea on hv-cinder-83538 Jul 26 17:14:04.190618 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-38084499-0e1f-4387-81a7-d4e79c7c7396 req-31b0c1fa-5d90-4496-8ce7-e60b1f323a39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060449 Jul 26 17:14:04.191987 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 54/115] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:04.220317 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-85a2376b-ae83-40cb-bbbd-eba94a7eb348 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:04.221530 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-85a2376b-ae83-40cb-bbbd-eba94a7eb348 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:04.234339 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85a2376b-ae83-40cb-bbbd-eba94a7eb348 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:04.235165 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85a2376b-ae83-40cb-bbbd-eba94a7eb348 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:04.236558 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85a2376b-ae83-40cb-bbbd-eba94a7eb348 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:04.237375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85a2376b-ae83-40cb-bbbd-eba94a7eb348 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:04.399823 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-85a2376b-ae83-40cb-bbbd-eba94a7eb348 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:04.409951 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-85a2376b-ae83-40cb-bbbd-eba94a7eb348 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:04.411649 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-85a2376b-ae83-40cb-bbbd-eba94a7eb348 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:04.412861 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-85a2376b-ae83-40cb-bbbd-eba94a7eb348 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.204022 Jul 26 17:14:04.413580 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 62/116] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:14:04 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:14:04.514936 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0dca25f7-f2a1-489a-8379-fe4de49ad4b8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:04.516131 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0dca25f7-f2a1-489a-8379-fe4de49ad4b8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:04.519453 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:04.529319 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0dca25f7-f2a1-489a-8379-fe4de49ad4b8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:04.530949 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0dca25f7-f2a1-489a-8379-fe4de49ad4b8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:04.532059 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0dca25f7-f2a1-489a-8379-fe4de49ad4b8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:04.532700 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0dca25f7-f2a1-489a-8379-fe4de49ad4b8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:04.630046 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c0fb73f4-6dce-4f2f-8db2-9070c5529021 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:04.631092 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c0fb73f4-6dce-4f2f-8db2-9070c5529021 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:04.639301 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c0fb73f4-6dce-4f2f-8db2-9070c5529021 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:04.640235 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c0fb73f4-6dce-4f2f-8db2-9070c5529021 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:04.641466 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c0fb73f4-6dce-4f2f-8db2-9070c5529021 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:04.642004 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c0fb73f4-6dce-4f2f-8db2-9070c5529021 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:04.760202 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0dca25f7-f2a1-489a-8379-fe4de49ad4b8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:04.768689 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0dca25f7-f2a1-489a-8379-fe4de49ad4b8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 0.261710 Jul 26 17:14:04.780148 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 55/117] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:04 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:04.907161 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c0fb73f4-6dce-4f2f-8db2-9070c5529021 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:04.925953 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c0fb73f4-6dce-4f2f-8db2-9070c5529021 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.299614 Jul 26 17:14:04.927525 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 63/118] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:04 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:05.028341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0009613c-06c3-480f-b18c-463fa9115850 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:05.029303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0009613c-06c3-480f-b18c-463fa9115850 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:05.038406 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0009613c-06c3-480f-b18c-463fa9115850 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:05.038892 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0009613c-06c3-480f-b18c-463fa9115850 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:05.039840 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0009613c-06c3-480f-b18c-463fa9115850 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:05.040285 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0009613c-06c3-480f-b18c-463fa9115850 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:05.239397 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0009613c-06c3-480f-b18c-463fa9115850 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:05.248485 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0009613c-06c3-480f-b18c-463fa9115850 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1322 microversion: 2.1 time: 0.224204 Jul 26 17:14:05.249812 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 56/119] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:05 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:05.437094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-09aaf56b-9c0f-4f37-add7-07a34385a24a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:05.437861 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-09aaf56b-9c0f-4f37-add7-07a34385a24a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:05.444751 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-09aaf56b-9c0f-4f37-add7-07a34385a24a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:05.445391 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-09aaf56b-9c0f-4f37-add7-07a34385a24a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:05.446281 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-09aaf56b-9c0f-4f37-add7-07a34385a24a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:05.446804 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-09aaf56b-9c0f-4f37-add7-07a34385a24a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:05.676172 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-09aaf56b-9c0f-4f37-add7-07a34385a24a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:05.693098 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-09aaf56b-9c0f-4f37-add7-07a34385a24a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:05.696050 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-09aaf56b-9c0f-4f37-add7-07a34385a24a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:05.697674 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-09aaf56b-9c0f-4f37-add7-07a34385a24a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.265518 Jul 26 17:14:05.705574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 64/120] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:14:05 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:14:05.803716 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-af95c4d7-168a-49ce-a74d-dbb0c61597e4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:05.804430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-af95c4d7-168a-49ce-a74d-dbb0c61597e4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:05.812222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-af95c4d7-168a-49ce-a74d-dbb0c61597e4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:05.812809 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-af95c4d7-168a-49ce-a74d-dbb0c61597e4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:05.813826 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-af95c4d7-168a-49ce-a74d-dbb0c61597e4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:05.814413 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-af95c4d7-168a-49ce-a74d-dbb0c61597e4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:05.956535 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-805c4a85-f05e-4fcd-b73d-2987fc9fe9c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:05.960210 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-805c4a85-f05e-4fcd-b73d-2987fc9fe9c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:05.970237 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-805c4a85-f05e-4fcd-b73d-2987fc9fe9c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:05.970702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-805c4a85-f05e-4fcd-b73d-2987fc9fe9c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:05.971534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-805c4a85-f05e-4fcd-b73d-2987fc9fe9c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:05.971992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-805c4a85-f05e-4fcd-b73d-2987fc9fe9c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:06.010577 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-af95c4d7-168a-49ce-a74d-dbb0c61597e4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:06.020463 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-af95c4d7-168a-49ce-a74d-dbb0c61597e4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 0.221244 Jul 26 17:14:06.033004 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 57/121] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:05 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:06.270915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-805c4a85-f05e-4fcd-b73d-2987fc9fe9c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:06.272632 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-91e9b9ac-ff44-4191-a305-5bcd8ceacaa3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:06.273285 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-91e9b9ac-ff44-4191-a305-5bcd8ceacaa3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:06.284447 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-91e9b9ac-ff44-4191-a305-5bcd8ceacaa3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:06.285707 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-91e9b9ac-ff44-4191-a305-5bcd8ceacaa3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:06.287019 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-91e9b9ac-ff44-4191-a305-5bcd8ceacaa3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:06.288173 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-91e9b9ac-ff44-4191-a305-5bcd8ceacaa3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:06.302316 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-805c4a85-f05e-4fcd-b73d-2987fc9fe9c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.350011 Jul 26 17:14:06.303586 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 65/122] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:05 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:06.589515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-91e9b9ac-ff44-4191-a305-5bcd8ceacaa3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:06.603229 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-91e9b9ac-ff44-4191-a305-5bcd8ceacaa3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1517 microversion: 2.1 time: 0.335284 Jul 26 17:14:06.604149 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 58/123] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:06 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1517 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:06.649344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-314d9eef-a110-4581-bfb3-6ef6fb56edef tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:06.653407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-314d9eef-a110-4581-bfb3-6ef6fb56edef tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:06.658230 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:06.669556 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-314d9eef-a110-4581-bfb3-6ef6fb56edef tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:06.671265 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-314d9eef-a110-4581-bfb3-6ef6fb56edef tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:06.672215 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-314d9eef-a110-4581-bfb3-6ef6fb56edef tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:06.672833 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-314d9eef-a110-4581-bfb3-6ef6fb56edef tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:06.703688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-314d9eef-a110-4581-bfb3-6ef6fb56edef tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lazy-loading 'flavor' on Instance uuid 6013d114-1110-4e9d-91c2-f4979c5630a8 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:14:06.724040 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ced455f5-9b8d-4369-a3a1-fc4909c5b8ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:06.725230 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ced455f5-9b8d-4369-a3a1-fc4909c5b8ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:06.739276 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ced455f5-9b8d-4369-a3a1-fc4909c5b8ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:06.740124 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ced455f5-9b8d-4369-a3a1-fc4909c5b8ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:06.741865 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ced455f5-9b8d-4369-a3a1-fc4909c5b8ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:06.746285 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ced455f5-9b8d-4369-a3a1-fc4909c5b8ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:06.801996 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=100 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:07.032933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-314d9eef-a110-4581-bfb3-6ef6fb56edef tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "POST /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8/action" status: 200 len: 32 microversion: 2.1 time: 0.392531 Jul 26 17:14:07.034812 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 66/124] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:14:06 2022] POST /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8/action => generated 32 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 17:14:07.069650 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0347037c-f663-464b-b857-adb42681127d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:07.071661 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0347037c-f663-464b-b857-adb42681127d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:07.101381 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0347037c-f663-464b-b857-adb42681127d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:07.102479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0347037c-f663-464b-b857-adb42681127d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:07.113853 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0347037c-f663-464b-b857-adb42681127d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:07.116761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0347037c-f663-464b-b857-adb42681127d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:07.203585 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ced455f5-9b8d-4369-a3a1-fc4909c5b8ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:07.221107 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ced455f5-9b8d-4369-a3a1-fc4909c5b8ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:07.226898 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ced455f5-9b8d-4369-a3a1-fc4909c5b8ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:07.231339 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ced455f5-9b8d-4369-a3a1-fc4909c5b8ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.508759 Jul 26 17:14:07.236058 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 59/125] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:14:06 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:14:07.261935 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6f7ff647-e7e7-43d2-ba95-d6cfd38ab975 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:07.262567 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6f7ff647-e7e7-43d2-ba95-d6cfd38ab975 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:07.279211 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6f7ff647-e7e7-43d2-ba95-d6cfd38ab975 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:07.280213 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6f7ff647-e7e7-43d2-ba95-d6cfd38ab975 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:07.283583 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6f7ff647-e7e7-43d2-ba95-d6cfd38ab975 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:07.285552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6f7ff647-e7e7-43d2-ba95-d6cfd38ab975 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:07.485229 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0347037c-f663-464b-b857-adb42681127d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:07.487686 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:07.503676 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0347037c-f663-464b-b857-adb42681127d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.454924 Jul 26 17:14:07.505998 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 67/126] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:07 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:07.518218 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cd5a2991-f3c1-490b-803e-55a662228472 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:07.519230 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cd5a2991-f3c1-490b-803e-55a662228472 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:07.527370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd5a2991-f3c1-490b-803e-55a662228472 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:07.528220 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd5a2991-f3c1-490b-803e-55a662228472 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:07.529335 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd5a2991-f3c1-490b-803e-55a662228472 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:07.530289 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6f7ff647-e7e7-43d2-ba95-d6cfd38ab975 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:07.530796 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd5a2991-f3c1-490b-803e-55a662228472 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:07.541313 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6f7ff647-e7e7-43d2-ba95-d6cfd38ab975 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1364 microversion: 2.1 time: 0.303769 Jul 26 17:14:07.542160 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 60/127] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:07 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:07.798443 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cd5a2991-f3c1-490b-803e-55a662228472 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:07.823604 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cd5a2991-f3c1-490b-803e-55a662228472 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.313245 Jul 26 17:14:07.824401 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 68/128] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:07 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:08.266757 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-82647100-1aa3-4ecf-a396-d356d46aef89 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:08.267482 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-82647100-1aa3-4ecf-a396-d356d46aef89 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:08.279585 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-82647100-1aa3-4ecf-a396-d356d46aef89 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:08.280084 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-82647100-1aa3-4ecf-a396-d356d46aef89 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:08.281315 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-82647100-1aa3-4ecf-a396-d356d46aef89 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:08.283690 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-82647100-1aa3-4ecf-a396-d356d46aef89 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:08.545919 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-26187df1-5823-4cc6-ac79-d88e3c8fbed1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:08.547552 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-26187df1-5823-4cc6-ac79-d88e3c8fbed1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:08.574371 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-26187df1-5823-4cc6-ac79-d88e3c8fbed1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:08.590562 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-26187df1-5823-4cc6-ac79-d88e3c8fbed1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:08.591655 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-26187df1-5823-4cc6-ac79-d88e3c8fbed1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:08.593456 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-26187df1-5823-4cc6-ac79-d88e3c8fbed1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:08.768214 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-82647100-1aa3-4ecf-a396-d356d46aef89 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:08.815935 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-82647100-1aa3-4ecf-a396-d356d46aef89 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:08.829020 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-82647100-1aa3-4ecf-a396-d356d46aef89 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:08.831544 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-82647100-1aa3-4ecf-a396-d356d46aef89 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.569241 Jul 26 17:14:08.844625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 61/129] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:14:08 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:14:08.897855 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-74eb70dc-90f4-4324-8fcd-8fd1c22ad859 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:08.899154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-74eb70dc-90f4-4324-8fcd-8fd1c22ad859 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:08.927899 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-74eb70dc-90f4-4324-8fcd-8fd1c22ad859 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:08.928675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-74eb70dc-90f4-4324-8fcd-8fd1c22ad859 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:08.930125 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-74eb70dc-90f4-4324-8fcd-8fd1c22ad859 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:08.931133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-74eb70dc-90f4-4324-8fcd-8fd1c22ad859 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:09.193805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-26187df1-5823-4cc6-ac79-d88e3c8fbed1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:09.213746 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-26187df1-5823-4cc6-ac79-d88e3c8fbed1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.673234 Jul 26 17:14:09.215933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 69/130] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:08 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:09.229401 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-74eb70dc-90f4-4324-8fcd-8fd1c22ad859 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:09.251054 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ea7524f3-480f-46e3-b94e-8832a8c5cb6d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:09.252274 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ea7524f3-480f-46e3-b94e-8832a8c5cb6d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:09.256877 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-74eb70dc-90f4-4324-8fcd-8fd1c22ad859 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1553 microversion: 2.1 time: 0.409801 Jul 26 17:14:09.257907 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 62/131] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:08 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1553 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:09.266126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea7524f3-480f-46e3-b94e-8832a8c5cb6d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:09.266126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea7524f3-480f-46e3-b94e-8832a8c5cb6d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:09.267416 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea7524f3-480f-46e3-b94e-8832a8c5cb6d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:09.268191 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea7524f3-480f-46e3-b94e-8832a8c5cb6d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:09.280456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8edd92a6-901e-4848-b6ed-a74153beab3d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:09.281205 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8edd92a6-901e-4848-b6ed-a74153beab3d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:09.288402 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8edd92a6-901e-4848-b6ed-a74153beab3d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:09.288981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8edd92a6-901e-4848-b6ed-a74153beab3d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:09.289957 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8edd92a6-901e-4848-b6ed-a74153beab3d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:09.290574 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8edd92a6-901e-4848-b6ed-a74153beab3d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:09.475097 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8edd92a6-901e-4848-b6ed-a74153beab3d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.199218 Jul 26 17:14:09.475693 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 63/132] 10.222.0.48 () {58 vars in 1275 bytes} [Tue Jul 26 17:14:09 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:14:09.522661 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ea7524f3-480f-46e3-b94e-8832a8c5cb6d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:09.533344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ea7524f3-480f-46e3-b94e-8832a8c5cb6d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.312545 Jul 26 17:14:09.534413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 70/133] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:09 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:09.894899 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-89234737-4c7e-46bd-a834-a86ed1021304 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:09.896077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-89234737-4c7e-46bd-a834-a86ed1021304 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:09.907758 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-89234737-4c7e-46bd-a834-a86ed1021304 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:09.908290 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-89234737-4c7e-46bd-a834-a86ed1021304 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:09.909288 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-89234737-4c7e-46bd-a834-a86ed1021304 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:09.910555 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-89234737-4c7e-46bd-a834-a86ed1021304 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:10.259437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-90ed5093-3920-424a-ab61-a678f1099462 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:10.260643 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-90ed5093-3920-424a-ab61-a678f1099462 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:10.273992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90ed5093-3920-424a-ab61-a678f1099462 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:10.274452 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90ed5093-3920-424a-ab61-a678f1099462 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:10.275253 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90ed5093-3920-424a-ab61-a678f1099462 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:10.275697 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90ed5093-3920-424a-ab61-a678f1099462 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:10.329856 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-89234737-4c7e-46bd-a834-a86ed1021304 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:10.354813 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-89234737-4c7e-46bd-a834-a86ed1021304 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:10.368243 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-89234737-4c7e-46bd-a834-a86ed1021304 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:10.372808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-89234737-4c7e-46bd-a834-a86ed1021304 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.483746 Jul 26 17:14:10.382291 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 64/134] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:14:09 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:14:10.497850 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-b9e64332-2251-44af-a510-22225fc7f4c2 req-6e9f5f24-446d-4b5e-b654-7bd63d211833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7d66fd-65f0-4c03-8f1e-93d1ec23d411", "name": "network-vif-plugged", "status": "completed", "tag": "5a304d69-32d1-40aa-b33c-fe4e3d47a965"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:10.535268 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-b9e64332-2251-44af-a510-22225fc7f4c2 req-6e9f5f24-446d-4b5e-b654-7bd63d211833 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:10.535676 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-b9e64332-2251-44af-a510-22225fc7f4c2 req-6e9f5f24-446d-4b5e-b654-7bd63d211833 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:10.562481 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-90ed5093-3920-424a-ab61-a678f1099462 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:10.571931 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-90ed5093-3920-424a-ab61-a678f1099462 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.316225 Jul 26 17:14:10.573424 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 71/135] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:10 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:10.575233 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-b9e64332-2251-44af-a510-22225fc7f4c2 req-6e9f5f24-446d-4b5e-b654-7bd63d211833 service nova] Creating event network-vif-plugged:5a304d69-32d1-40aa-b33c-fe4e3d47a965 for instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 on hv-cinder-83538 Jul 26 17:14:10.588427 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ce884bf4-7822-4ac0-8ad0-697b4bc424ed tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:10.589362 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ce884bf4-7822-4ac0-8ad0-697b4bc424ed tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:10.592051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-b9e64332-2251-44af-a510-22225fc7f4c2 req-6e9f5f24-446d-4b5e-b654-7bd63d211833 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103094 Jul 26 17:14:10.597420 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 65/136] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:10.598450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce884bf4-7822-4ac0-8ad0-697b4bc424ed tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:10.599125 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce884bf4-7822-4ac0-8ad0-697b4bc424ed tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:10.600115 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce884bf4-7822-4ac0-8ad0-697b4bc424ed tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:10.600772 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce884bf4-7822-4ac0-8ad0-697b4bc424ed tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:10.787295 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ce884bf4-7822-4ac0-8ad0-697b4bc424ed tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:10.797431 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ce884bf4-7822-4ac0-8ad0-697b4bc424ed tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.222687 Jul 26 17:14:10.798326 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 72/137] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:10 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:11.438276 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4f394db3-2a7a-4901-bbda-923dae094ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:11.439528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4f394db3-2a7a-4901-bbda-923dae094ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:11.480650 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f394db3-2a7a-4901-bbda-923dae094ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:11.481175 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f394db3-2a7a-4901-bbda-923dae094ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:11.481947 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f394db3-2a7a-4901-bbda-923dae094ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:11.482408 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f394db3-2a7a-4901-bbda-923dae094ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:11.601567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d4adbdbe-b42a-40c3-9f16-74d0a2dce764 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:11.603037 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d4adbdbe-b42a-40c3-9f16-74d0a2dce764 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:11.615606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4adbdbe-b42a-40c3-9f16-74d0a2dce764 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:11.616673 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4adbdbe-b42a-40c3-9f16-74d0a2dce764 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:11.618183 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4adbdbe-b42a-40c3-9f16-74d0a2dce764 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:11.619074 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4adbdbe-b42a-40c3-9f16-74d0a2dce764 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:11.860757 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d4adbdbe-b42a-40c3-9f16-74d0a2dce764 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:11.878380 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d4adbdbe-b42a-40c3-9f16-74d0a2dce764 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.287671 Jul 26 17:14:11.880246 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 73/138] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:11 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:11.890711 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0a0cb21c-0ec0-4827-bbff-3d14d1b9025d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:11.892010 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0a0cb21c-0ec0-4827-bbff-3d14d1b9025d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:11.901046 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a0cb21c-0ec0-4827-bbff-3d14d1b9025d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:11.901878 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a0cb21c-0ec0-4827-bbff-3d14d1b9025d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:11.903079 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a0cb21c-0ec0-4827-bbff-3d14d1b9025d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:11.903736 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a0cb21c-0ec0-4827-bbff-3d14d1b9025d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:12.009583 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4f394db3-2a7a-4901-bbda-923dae094ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:12.021174 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4f394db3-2a7a-4901-bbda-923dae094ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:12.023113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4f394db3-2a7a-4901-bbda-923dae094ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:12.024775 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4f394db3-2a7a-4901-bbda-923dae094ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.613345 Jul 26 17:14:12.026118 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 66/139] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:14:11 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:14:12.031636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-f7a2f7ed-6c6f-42cd-a1ce-262fbea7aa6b req-6e921a03-fe12-469d-85fa-667e58e0147c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20195acb-7356-4e87-a2a8-1ee88cd3e3ea", "tag": "e663e87f-330a-4fa0-96d9-10ce8af7ff1a"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:12.055665 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-f7a2f7ed-6c6f-42cd-a1ce-262fbea7aa6b req-6e921a03-fe12-469d-85fa-667e58e0147c service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:12.057495 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-f7a2f7ed-6c6f-42cd-a1ce-262fbea7aa6b req-6e921a03-fe12-469d-85fa-667e58e0147c service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:12.082001 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-f7a2f7ed-6c6f-42cd-a1ce-262fbea7aa6b req-6e921a03-fe12-469d-85fa-667e58e0147c service nova] Creating event network-changed:e663e87f-330a-4fa0-96d9-10ce8af7ff1a for instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea on hv-cinder-83538 Jul 26 17:14:12.092899 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-f7a2f7ed-6c6f-42cd-a1ce-262fbea7aa6b req-6e921a03-fe12-469d-85fa-667e58e0147c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063790 Jul 26 17:14:12.095269 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 67/140] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:12.518418 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0a0cb21c-0ec0-4827-bbff-3d14d1b9025d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:12.536751 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0a0cb21c-0ec0-4827-bbff-3d14d1b9025d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.654177 Jul 26 17:14:12.538532 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 74/141] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:11 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:12.684644 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-3ff3f97e-9c66-441b-a923-2267f9f8b030 req-7415081b-6fd2-4aab-b298-290338d1e9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2799ba4-de59-4849-85e7-d0aaf12578e1", "name": "network-vif-plugged", "status": "completed", "tag": "046c2444-d052-4814-b962-6109cd25ef6e"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:12.714516 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-3ff3f97e-9c66-441b-a923-2267f9f8b030 req-7415081b-6fd2-4aab-b298-290338d1e9e1 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:12.717024 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-3ff3f97e-9c66-441b-a923-2267f9f8b030 req-7415081b-6fd2-4aab-b298-290338d1e9e1 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:12.741607 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-3ff3f97e-9c66-441b-a923-2267f9f8b030 req-7415081b-6fd2-4aab-b298-290338d1e9e1 service nova] Creating event network-vif-plugged:046c2444-d052-4814-b962-6109cd25ef6e for instance e2799ba4-de59-4849-85e7-d0aaf12578e1 on hv-cinder-83538 Jul 26 17:14:12.753944 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-3ff3f97e-9c66-441b-a923-2267f9f8b030 req-7415081b-6fd2-4aab-b298-290338d1e9e1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075612 Jul 26 17:14:12.755237 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 68/142] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:12.942739 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-61b02b23-0061-4b05-af72-a3057ce492e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:12.945796 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-61b02b23-0061-4b05-af72-a3057ce492e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:12.977033 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61b02b23-0061-4b05-af72-a3057ce492e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:12.977792 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61b02b23-0061-4b05-af72-a3057ce492e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:12.979136 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61b02b23-0061-4b05-af72-a3057ce492e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:12.979887 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61b02b23-0061-4b05-af72-a3057ce492e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:13.054194 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6dad71d4-f865-433a-90e9-3a1943b297cd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:13.055184 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6dad71d4-f865-433a-90e9-3a1943b297cd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:13.067369 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6dad71d4-f865-433a-90e9-3a1943b297cd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:13.068295 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6dad71d4-f865-433a-90e9-3a1943b297cd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:13.069558 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6dad71d4-f865-433a-90e9-3a1943b297cd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:13.070150 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6dad71d4-f865-433a-90e9-3a1943b297cd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:13.258006 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-61b02b23-0061-4b05-af72-a3057ce492e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:13.266740 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-61b02b23-0061-4b05-af72-a3057ce492e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.350935 Jul 26 17:14:13.267630 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 75/143] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:12 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:13.338258 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6dad71d4-f865-433a-90e9-3a1943b297cd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:13.351803 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6dad71d4-f865-433a-90e9-3a1943b297cd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:13.353653 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6dad71d4-f865-433a-90e9-3a1943b297cd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:13.362541 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6dad71d4-f865-433a-90e9-3a1943b297cd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.315155 Jul 26 17:14:13.366164 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 69/144] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:14:13 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:14:13.490246 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-29a2e14f-638a-4639-a368-5b3b6187c2b8 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:13.491013 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-29a2e14f-638a-4639-a368-5b3b6187c2b8 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:13.498802 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29a2e14f-638a-4639-a368-5b3b6187c2b8 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:13.499690 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29a2e14f-638a-4639-a368-5b3b6187c2b8 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:13.500692 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29a2e14f-638a-4639-a368-5b3b6187c2b8 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:13.501352 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29a2e14f-638a-4639-a368-5b3b6187c2b8 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:13.535193 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-29a2e14f-638a-4639-a368-5b3b6187c2b8 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:14:13.580387 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d3edb056-48d5-42b1-a2d5-deb344262f89 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:13.581352 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d3edb056-48d5-42b1-a2d5-deb344262f89 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:13.593904 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d3edb056-48d5-42b1-a2d5-deb344262f89 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:13.594695 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d3edb056-48d5-42b1-a2d5-deb344262f89 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:13.604485 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d3edb056-48d5-42b1-a2d5-deb344262f89 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:13.607329 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d3edb056-48d5-42b1-a2d5-deb344262f89 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:13.736436 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-29a2e14f-638a-4639-a368-5b3b6187c2b8 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 204 len: 0 microversion: 2.1 time: 0.250847 Jul 26 17:14:13.737903 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 76/145] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:14:13 2022] DELETE /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:14:13.756597 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5d973fed-5a4a-4549-9bbe-7d21a552b3c5 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:13.759122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5d973fed-5a4a-4549-9bbe-7d21a552b3c5 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:13.769764 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d973fed-5a4a-4549-9bbe-7d21a552b3c5 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:13.779983 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d973fed-5a4a-4549-9bbe-7d21a552b3c5 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:13.783438 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d973fed-5a4a-4549-9bbe-7d21a552b3c5 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:13.785142 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d973fed-5a4a-4549-9bbe-7d21a552b3c5 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:14.055853 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d3edb056-48d5-42b1-a2d5-deb344262f89 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:14.067829 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d3edb056-48d5-42b1-a2d5-deb344262f89 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.495778 Jul 26 17:14:14.071052 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 70/146] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:13 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:14.089667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5d973fed-5a4a-4549-9bbe-7d21a552b3c5 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:14.101277 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5d973fed-5a4a-4549-9bbe-7d21a552b3c5 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1553 microversion: 2.1 time: 0.357972 Jul 26 17:14:14.104594 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 77/147] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:13 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1553 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:14.307290 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4adbd307-11cd-4510-a8c7-9d4ba236f9d6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:14.308370 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4adbd307-11cd-4510-a8c7-9d4ba236f9d6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:14.321971 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4adbd307-11cd-4510-a8c7-9d4ba236f9d6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:14.322496 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4adbd307-11cd-4510-a8c7-9d4ba236f9d6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:14.323993 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4adbd307-11cd-4510-a8c7-9d4ba236f9d6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:14.330369 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4adbd307-11cd-4510-a8c7-9d4ba236f9d6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:14.405843 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f65122a2-1df7-4d1b-b34e-5bee44b9b29d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:14.406695 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f65122a2-1df7-4d1b-b34e-5bee44b9b29d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:14.414182 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f65122a2-1df7-4d1b-b34e-5bee44b9b29d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:14.414715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f65122a2-1df7-4d1b-b34e-5bee44b9b29d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:14.416050 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f65122a2-1df7-4d1b-b34e-5bee44b9b29d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:14.416522 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f65122a2-1df7-4d1b-b34e-5bee44b9b29d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:14.591583 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4adbd307-11cd-4510-a8c7-9d4ba236f9d6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:14.609608 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4adbd307-11cd-4510-a8c7-9d4ba236f9d6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.305994 Jul 26 17:14:14.614958 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 71/148] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:14 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:14.674735 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f65122a2-1df7-4d1b-b34e-5bee44b9b29d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:14.685645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f65122a2-1df7-4d1b-b34e-5bee44b9b29d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:14.688469 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f65122a2-1df7-4d1b-b34e-5bee44b9b29d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:14.691027 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f65122a2-1df7-4d1b-b34e-5bee44b9b29d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1408 microversion: 2.20 time: 0.289870 Jul 26 17:14:14.692114 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 78/149] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:14:14 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:14:15.091326 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4362661f-05de-46c2-8dc5-544803673862 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:15.092195 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4362661f-05de-46c2-8dc5-544803673862 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:15.108996 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4362661f-05de-46c2-8dc5-544803673862 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:15.109815 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4362661f-05de-46c2-8dc5-544803673862 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:15.111626 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4362661f-05de-46c2-8dc5-544803673862 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:15.112619 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4362661f-05de-46c2-8dc5-544803673862 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:15.128143 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-41164417-832a-4fea-a974-9a74f656b1a2 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:15.129528 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-41164417-832a-4fea-a974-9a74f656b1a2 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:15.141811 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-41164417-832a-4fea-a974-9a74f656b1a2 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:15.144186 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-41164417-832a-4fea-a974-9a74f656b1a2 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:15.145358 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-41164417-832a-4fea-a974-9a74f656b1a2 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:15.148288 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-41164417-832a-4fea-a974-9a74f656b1a2 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:15.327292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4362661f-05de-46c2-8dc5-544803673862 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:15.344655 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4362661f-05de-46c2-8dc5-544803673862 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.257095 Jul 26 17:14:15.345688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 72/150] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:15 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:15.396753 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-41164417-832a-4fea-a974-9a74f656b1a2 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:15.413117 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-41164417-832a-4fea-a974-9a74f656b1a2 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1553 microversion: 2.1 time: 0.289999 Jul 26 17:14:15.414293 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 79/151] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:15 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1553 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:15.636625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e09cc84a-5f6f-4e2c-bbab-5845eb66740c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:15.637527 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-e09cc84a-5f6f-4e2c-bbab-5845eb66740c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:15.648857 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e09cc84a-5f6f-4e2c-bbab-5845eb66740c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:15.650576 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e09cc84a-5f6f-4e2c-bbab-5845eb66740c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:15.652629 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e09cc84a-5f6f-4e2c-bbab-5845eb66740c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:15.654040 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e09cc84a-5f6f-4e2c-bbab-5845eb66740c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:15.715174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2b08d877-e83b-498e-91cc-9223a2993242 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:15.715894 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2b08d877-e83b-498e-91cc-9223a2993242 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:15.725254 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b08d877-e83b-498e-91cc-9223a2993242 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:15.729238 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b08d877-e83b-498e-91cc-9223a2993242 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:15.730539 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b08d877-e83b-498e-91cc-9223a2993242 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:15.737237 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b08d877-e83b-498e-91cc-9223a2993242 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:15.837186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e09cc84a-5f6f-4e2c-bbab-5845eb66740c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:15.877571 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e09cc84a-5f6f-4e2c-bbab-5845eb66740c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.244495 Jul 26 17:14:15.882199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 73/152] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:15 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:15.983343 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2b08d877-e83b-498e-91cc-9223a2993242 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:16.015942 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2b08d877-e83b-498e-91cc-9223a2993242 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:16.019319 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2b08d877-e83b-498e-91cc-9223a2993242 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:16.034471 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2b08d877-e83b-498e-91cc-9223a2993242 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1600 microversion: 2.20 time: 0.322790 Jul 26 17:14:16.035519 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 80/153] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:14:15 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1600 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:14:16.068860 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-dc67b6de-75bb-47be-9abc-5ded17947420 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:16.070843 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-dc67b6de-75bb-47be-9abc-5ded17947420 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:16.084939 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dc67b6de-75bb-47be-9abc-5ded17947420 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:16.085797 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dc67b6de-75bb-47be-9abc-5ded17947420 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:16.087612 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dc67b6de-75bb-47be-9abc-5ded17947420 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:16.087797 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dc67b6de-75bb-47be-9abc-5ded17947420 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:16.293764 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-dc67b6de-75bb-47be-9abc-5ded17947420 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.237475 Jul 26 17:14:16.297073 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 74/154] 10.222.0.48 () {60 vars in 1316 bytes} [Tue Jul 26 17:14:16 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-interface => generated 284 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:14:16.381899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5d925ae2-fc4a-4f8e-94e8-56a827465a6c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:16.385370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5d925ae2-fc4a-4f8e-94e8-56a827465a6c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:16.400991 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d925ae2-fc4a-4f8e-94e8-56a827465a6c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:16.401815 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d925ae2-fc4a-4f8e-94e8-56a827465a6c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:16.403270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d925ae2-fc4a-4f8e-94e8-56a827465a6c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:16.404129 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d925ae2-fc4a-4f8e-94e8-56a827465a6c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:16.435071 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-38ab63f8-9d16-4b24-a972-f32867bd6a22 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:16.436482 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-38ab63f8-9d16-4b24-a972-f32867bd6a22 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:16.443460 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-38ab63f8-9d16-4b24-a972-f32867bd6a22 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:16.444233 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-38ab63f8-9d16-4b24-a972-f32867bd6a22 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:16.445295 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-38ab63f8-9d16-4b24-a972-f32867bd6a22 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:16.445939 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-38ab63f8-9d16-4b24-a972-f32867bd6a22 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:16.675716 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5d925ae2-fc4a-4f8e-94e8-56a827465a6c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:16.690529 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5d925ae2-fc4a-4f8e-94e8-56a827465a6c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.322424 Jul 26 17:14:16.703475 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 81/155] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:16 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:16.876481 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-38ab63f8-9d16-4b24-a972-f32867bd6a22 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:16.894526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-38ab63f8-9d16-4b24-a972-f32867bd6a22 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1553 microversion: 2.1 time: 0.462837 Jul 26 17:14:16.895946 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 75/156] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:16 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1553 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:16.928221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79831397-0bef-49e0-95f7-d0064ae01e35 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:16.929489 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79831397-0bef-49e0-95f7-d0064ae01e35 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:16.943338 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79831397-0bef-49e0-95f7-d0064ae01e35 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:16.944272 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79831397-0bef-49e0-95f7-d0064ae01e35 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:16.946052 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79831397-0bef-49e0-95f7-d0064ae01e35 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:16.947562 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79831397-0bef-49e0-95f7-d0064ae01e35 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:17.188814 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79831397-0bef-49e0-95f7-d0064ae01e35 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:17.193321 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:17.210165 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79831397-0bef-49e0-95f7-d0064ae01e35 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.289542 Jul 26 17:14:17.210165 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 82/157] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:16 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:17.729623 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-317468d2-03e6-4c21-93d3-837777265b26 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:17.730361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-317468d2-03e6-4c21-93d3-837777265b26 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:17.737126 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-317468d2-03e6-4c21-93d3-837777265b26 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:17.737874 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-317468d2-03e6-4c21-93d3-837777265b26 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:17.738676 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-317468d2-03e6-4c21-93d3-837777265b26 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:17.739289 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-317468d2-03e6-4c21-93d3-837777265b26 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:17.934343 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1dac4983-ca6e-45e9-bf30-1644657ddb26 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:17.935767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1dac4983-ca6e-45e9-bf30-1644657ddb26 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:17.947793 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1dac4983-ca6e-45e9-bf30-1644657ddb26 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:17.948982 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1dac4983-ca6e-45e9-bf30-1644657ddb26 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:17.950490 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1dac4983-ca6e-45e9-bf30-1644657ddb26 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:17.951644 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1dac4983-ca6e-45e9-bf30-1644657ddb26 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:18.001417 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-317468d2-03e6-4c21-93d3-837777265b26 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:18.018064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-317468d2-03e6-4c21-93d3-837777265b26 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.296281 Jul 26 17:14:18.019624 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 76/158] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:17 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:18.182024 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1dac4983-ca6e-45e9-bf30-1644657ddb26 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:18.213225 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1dac4983-ca6e-45e9-bf30-1644657ddb26 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1553 microversion: 2.1 time: 0.278865 Jul 26 17:14:18.231373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 83/159] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:17 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:18.238694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-3bcc7ce9-3877-477b-b690-01e43070dab2 req-f710dd2c-f1cc-4851-aa48-776ebc595eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c7d66fd-65f0-4c03-8f1e-93d1ec23d411", "tag": "5a304d69-32d1-40aa-b33c-fe4e3d47a965"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:18.250267 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b9a8ee99-5150-403c-b280-c9d48ede3a43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:18.251509 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b9a8ee99-5150-403c-b280-c9d48ede3a43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:18.253706 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-3bcc7ce9-3877-477b-b690-01e43070dab2 req-f710dd2c-f1cc-4851-aa48-776ebc595eb1 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:18.254724 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-3bcc7ce9-3877-477b-b690-01e43070dab2 req-f710dd2c-f1cc-4851-aa48-776ebc595eb1 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:18.262090 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9a8ee99-5150-403c-b280-c9d48ede3a43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:18.262781 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9a8ee99-5150-403c-b280-c9d48ede3a43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:18.263906 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9a8ee99-5150-403c-b280-c9d48ede3a43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:18.264551 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9a8ee99-5150-403c-b280-c9d48ede3a43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:18.273571 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-3bcc7ce9-3877-477b-b690-01e43070dab2 req-f710dd2c-f1cc-4851-aa48-776ebc595eb1 service nova] Creating event network-changed:5a304d69-32d1-40aa-b33c-fe4e3d47a965 for instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 on hv-cinder-83538 Jul 26 17:14:18.281112 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-3bcc7ce9-3877-477b-b690-01e43070dab2 req-f710dd2c-f1cc-4851-aa48-776ebc595eb1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062406 Jul 26 17:14:18.282435 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 77/160] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:18.494871 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b9a8ee99-5150-403c-b280-c9d48ede3a43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:18.507869 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b9a8ee99-5150-403c-b280-c9d48ede3a43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.265226 Jul 26 17:14:18.510044 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 84/161] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:18 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:19.041840 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8dd92b8c-243b-451b-9a2d-82e9ecd9864b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:19.042535 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8dd92b8c-243b-451b-9a2d-82e9ecd9864b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:19.049398 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8dd92b8c-243b-451b-9a2d-82e9ecd9864b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:19.049841 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8dd92b8c-243b-451b-9a2d-82e9ecd9864b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:19.050871 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8dd92b8c-243b-451b-9a2d-82e9ecd9864b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:19.051302 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8dd92b8c-243b-451b-9a2d-82e9ecd9864b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:19.198398 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8dd92b8c-243b-451b-9a2d-82e9ecd9864b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:19.209582 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8dd92b8c-243b-451b-9a2d-82e9ecd9864b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.171862 Jul 26 17:14:19.210250 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 78/162] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:19 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:19.252195 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-64ca6bcd-8b1e-4e1a-9d38-e99823b96785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:19.253479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-64ca6bcd-8b1e-4e1a-9d38-e99823b96785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:19.267201 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64ca6bcd-8b1e-4e1a-9d38-e99823b96785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:19.268121 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64ca6bcd-8b1e-4e1a-9d38-e99823b96785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:19.269556 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64ca6bcd-8b1e-4e1a-9d38-e99823b96785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:19.270423 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64ca6bcd-8b1e-4e1a-9d38-e99823b96785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:19.439741 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-64ca6bcd-8b1e-4e1a-9d38-e99823b96785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:19.449389 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-64ca6bcd-8b1e-4e1a-9d38-e99823b96785 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1553 microversion: 2.1 time: 0.205476 Jul 26 17:14:19.449389 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 85/163] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:19 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:19.537698 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-52a6e8cb-8c0f-4741-8fd7-dcc8c5afc011 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:19.538317 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-52a6e8cb-8c0f-4741-8fd7-dcc8c5afc011 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:19.545733 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-52a6e8cb-8c0f-4741-8fd7-dcc8c5afc011 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:19.546558 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-52a6e8cb-8c0f-4741-8fd7-dcc8c5afc011 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:19.547466 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-52a6e8cb-8c0f-4741-8fd7-dcc8c5afc011 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:19.547909 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-52a6e8cb-8c0f-4741-8fd7-dcc8c5afc011 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:19.595830 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=100 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:19.732900 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-52a6e8cb-8c0f-4741-8fd7-dcc8c5afc011 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:19.742754 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-52a6e8cb-8c0f-4741-8fd7-dcc8c5afc011 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.209023 Jul 26 17:14:19.743629 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 79/164] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:19 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:20.230968 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b3133e78-faf6-4d8f-9dec-624f337b9548 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:20.231594 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b3133e78-faf6-4d8f-9dec-624f337b9548 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:20.238733 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3133e78-faf6-4d8f-9dec-624f337b9548 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:20.239180 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3133e78-faf6-4d8f-9dec-624f337b9548 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:20.239944 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3133e78-faf6-4d8f-9dec-624f337b9548 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:20.240374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3133e78-faf6-4d8f-9dec-624f337b9548 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:20.389611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b3133e78-faf6-4d8f-9dec-624f337b9548 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:20.398389 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b3133e78-faf6-4d8f-9dec-624f337b9548 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.170197 Jul 26 17:14:20.398389 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 86/165] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:20 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:20.470723 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-dc8bc5c5-57e3-424c-8f37-5f517a4b654d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:20.471395 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-dc8bc5c5-57e3-424c-8f37-5f517a4b654d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:20.477585 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dc8bc5c5-57e3-424c-8f37-5f517a4b654d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:20.478035 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dc8bc5c5-57e3-424c-8f37-5f517a4b654d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:20.478802 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dc8bc5c5-57e3-424c-8f37-5f517a4b654d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:20.479237 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dc8bc5c5-57e3-424c-8f37-5f517a4b654d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:20.629434 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-dc8bc5c5-57e3-424c-8f37-5f517a4b654d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:20.637806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-dc8bc5c5-57e3-424c-8f37-5f517a4b654d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1553 microversion: 2.1 time: 0.171524 Jul 26 17:14:20.638400 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 80/166] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:20 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:20.767461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6ea5f94f-55cd-473b-a429-c90027bc2ac3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:20.768586 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6ea5f94f-55cd-473b-a429-c90027bc2ac3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:20.777939 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ea5f94f-55cd-473b-a429-c90027bc2ac3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:20.778531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ea5f94f-55cd-473b-a429-c90027bc2ac3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:20.779844 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ea5f94f-55cd-473b-a429-c90027bc2ac3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:20.780293 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ea5f94f-55cd-473b-a429-c90027bc2ac3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:20.946401 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6ea5f94f-55cd-473b-a429-c90027bc2ac3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:20.956342 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6ea5f94f-55cd-473b-a429-c90027bc2ac3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.195311 Jul 26 17:14:20.957290 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 87/167] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:20 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:21.419583 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8952b8c1-f523-45b4-ad38-ce8f47282fc9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:21.420403 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8952b8c1-f523-45b4-ad38-ce8f47282fc9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:21.426716 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8952b8c1-f523-45b4-ad38-ce8f47282fc9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:21.427169 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8952b8c1-f523-45b4-ad38-ce8f47282fc9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:21.427939 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8952b8c1-f523-45b4-ad38-ce8f47282fc9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:21.428375 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8952b8c1-f523-45b4-ad38-ce8f47282fc9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:21.566666 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8952b8c1-f523-45b4-ad38-ce8f47282fc9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:21.574391 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8952b8c1-f523-45b4-ad38-ce8f47282fc9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.158519 Jul 26 17:14:21.574976 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 81/168] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:21 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:21.659677 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b9462207-90be-44ea-ba6d-efcd8fb20b5c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:21.660322 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b9462207-90be-44ea-ba6d-efcd8fb20b5c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:21.667337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9462207-90be-44ea-ba6d-efcd8fb20b5c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:21.667792 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9462207-90be-44ea-ba6d-efcd8fb20b5c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:21.668575 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9462207-90be-44ea-ba6d-efcd8fb20b5c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:21.669035 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9462207-90be-44ea-ba6d-efcd8fb20b5c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:21.806254 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b9462207-90be-44ea-ba6d-efcd8fb20b5c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:21.815315 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b9462207-90be-44ea-ba6d-efcd8fb20b5c tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1553 microversion: 2.1 time: 0.159558 Jul 26 17:14:21.815883 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 88/169] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:21 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:21.979694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7bf53284-e247-4695-8a8b-b616066d1666 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:21.980330 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7bf53284-e247-4695-8a8b-b616066d1666 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:21.987505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7bf53284-e247-4695-8a8b-b616066d1666 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:21.987951 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7bf53284-e247-4695-8a8b-b616066d1666 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:21.988719 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7bf53284-e247-4695-8a8b-b616066d1666 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:21.989190 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7bf53284-e247-4695-8a8b-b616066d1666 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:22.125667 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7bf53284-e247-4695-8a8b-b616066d1666 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:22.133406 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7bf53284-e247-4695-8a8b-b616066d1666 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.157571 Jul 26 17:14:22.133979 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 82/170] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:21 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:22.596829 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-637deaea-cbb7-44b9-8b6c-60efcf5aac71 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:22.597463 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-637deaea-cbb7-44b9-8b6c-60efcf5aac71 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:22.603683 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-637deaea-cbb7-44b9-8b6c-60efcf5aac71 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:22.604131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-637deaea-cbb7-44b9-8b6c-60efcf5aac71 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:22.604908 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-637deaea-cbb7-44b9-8b6c-60efcf5aac71 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:22.605369 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-637deaea-cbb7-44b9-8b6c-60efcf5aac71 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:22.757737 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-637deaea-cbb7-44b9-8b6c-60efcf5aac71 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:22.767008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-637deaea-cbb7-44b9-8b6c-60efcf5aac71 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1363 microversion: 2.1 time: 0.174981 Jul 26 17:14:22.767600 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 89/171] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:22 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:22.835721 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7c85aa96-76b2-4056-9c5a-954c5424a027 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:22.836341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7c85aa96-76b2-4056-9c5a-954c5424a027 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:22.842846 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7c85aa96-76b2-4056-9c5a-954c5424a027 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:22.843401 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7c85aa96-76b2-4056-9c5a-954c5424a027 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:22.844212 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7c85aa96-76b2-4056-9c5a-954c5424a027 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:22.844649 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7c85aa96-76b2-4056-9c5a-954c5424a027 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:22.987076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7c85aa96-76b2-4056-9c5a-954c5424a027 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:22.996293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7c85aa96-76b2-4056-9c5a-954c5424a027 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1553 microversion: 2.1 time: 0.164388 Jul 26 17:14:22.997593 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 83/172] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:22 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:23.093529 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-246e5b98-469e-4f5a-8181-dae0e32d204c req-a63da78c-9d6c-4ff4-8472-1ca100474a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4766fe-3ad8-492b-a9b0-4dbd07758a75", "name": "network-vif-unplugged", "status": "completed", "tag": "7479245d-123e-46b1-91f6-427bf645d105"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:23.103881 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-246e5b98-469e-4f5a-8181-dae0e32d204c req-a63da78c-9d6c-4ff4-8472-1ca100474a5b service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:23.104573 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-246e5b98-469e-4f5a-8181-dae0e32d204c req-a63da78c-9d6c-4ff4-8472-1ca100474a5b service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:23.126199 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-246e5b98-469e-4f5a-8181-dae0e32d204c req-a63da78c-9d6c-4ff4-8472-1ca100474a5b service nova] Creating event network-vif-unplugged:7479245d-123e-46b1-91f6-427bf645d105 for instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 on hv-cinder-83538 Jul 26 17:14:23.133753 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-246e5b98-469e-4f5a-8181-dae0e32d204c req-a63da78c-9d6c-4ff4-8472-1ca100474a5b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044187 Jul 26 17:14:23.135300 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 90/173] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:14:23.156541 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ab3d4323-5d11-4df4-9c2c-55b7d8ab03e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:23.157940 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ab3d4323-5d11-4df4-9c2c-55b7d8ab03e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:23.167825 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ab3d4323-5d11-4df4-9c2c-55b7d8ab03e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:23.169641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ab3d4323-5d11-4df4-9c2c-55b7d8ab03e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:23.169641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ab3d4323-5d11-4df4-9c2c-55b7d8ab03e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:23.170653 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ab3d4323-5d11-4df4-9c2c-55b7d8ab03e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:23.415295 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ab3d4323-5d11-4df4-9c2c-55b7d8ab03e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:23.424388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ab3d4323-5d11-4df4-9c2c-55b7d8ab03e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.273118 Jul 26 17:14:23.425118 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 84/174] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:23 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:23.789708 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b0157c55-9d0a-4800-a2d3-6a34e0d41fa4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:23.790732 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b0157c55-9d0a-4800-a2d3-6a34e0d41fa4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:23.799033 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0157c55-9d0a-4800-a2d3-6a34e0d41fa4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:23.799834 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0157c55-9d0a-4800-a2d3-6a34e0d41fa4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:23.800675 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0157c55-9d0a-4800-a2d3-6a34e0d41fa4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:23.801241 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0157c55-9d0a-4800-a2d3-6a34e0d41fa4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:23.961717 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b0157c55-9d0a-4800-a2d3-6a34e0d41fa4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:23.969837 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b0157c55-9d0a-4800-a2d3-6a34e0d41fa4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1548 microversion: 2.1 time: 0.185595 Jul 26 17:14:23.970421 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 91/175] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:23 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1548 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:23.991919 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c50031eb-a00f-4cc1-b596-71b8600c75f4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:23.992457 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c50031eb-a00f-4cc1-b596-71b8600c75f4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:23.999652 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c50031eb-a00f-4cc1-b596-71b8600c75f4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:24.000109 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c50031eb-a00f-4cc1-b596-71b8600c75f4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:24.000900 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c50031eb-a00f-4cc1-b596-71b8600c75f4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:24.001377 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c50031eb-a00f-4cc1-b596-71b8600c75f4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:24.023959 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-701ed81a-871a-4789-857b-50097fed18e1 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:24.024910 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-701ed81a-871a-4789-857b-50097fed18e1 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:24.035903 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-701ed81a-871a-4789-857b-50097fed18e1 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:24.036365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-701ed81a-871a-4789-857b-50097fed18e1 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:24.037208 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-701ed81a-871a-4789-857b-50097fed18e1 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:24.037684 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-701ed81a-871a-4789-857b-50097fed18e1 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:24.101365 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c50031eb-a00f-4cc1-b596-71b8600c75f4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113261 Jul 26 17:14:24.102070 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 85/176] 10.222.0.48 () {58 vars in 1275 bytes} [Tue Jul 26 17:14:23 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:24.198211 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-701ed81a-871a-4789-857b-50097fed18e1 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:24.208307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-701ed81a-871a-4789-857b-50097fed18e1 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1553 microversion: 2.1 time: 0.188564 Jul 26 17:14:24.208911 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 92/177] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:24 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:24.462587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1b2c4c62-8369-417d-8a84-09fadb6867d2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:24.464505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1b2c4c62-8369-417d-8a84-09fadb6867d2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:24.479960 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b2c4c62-8369-417d-8a84-09fadb6867d2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:24.481330 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b2c4c62-8369-417d-8a84-09fadb6867d2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:24.484196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b2c4c62-8369-417d-8a84-09fadb6867d2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:24.485491 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b2c4c62-8369-417d-8a84-09fadb6867d2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:24.910254 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1b2c4c62-8369-417d-8a84-09fadb6867d2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:24.917470 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1b2c4c62-8369-417d-8a84-09fadb6867d2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.466465 Jul 26 17:14:24.918055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 86/178] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:24 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:25.198273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-8f01d85c-7a7e-4b47-87cb-94cd5471f7db req-7780ea11-5e0f-4241-8600-968dc62341b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4766fe-3ad8-492b-a9b0-4dbd07758a75", "name": "network-vif-deleted", "tag": "7479245d-123e-46b1-91f6-427bf645d105"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:25.222341 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-8f01d85c-7a7e-4b47-87cb-94cd5471f7db req-7780ea11-5e0f-4241-8600-968dc62341b0 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:25.228040 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-8f01d85c-7a7e-4b47-87cb-94cd5471f7db req-7780ea11-5e0f-4241-8600-968dc62341b0 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:25.240780 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-82fdd0ae-474e-49c2-9377-83f1babad26d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:25.249825 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-82fdd0ae-474e-49c2-9377-83f1babad26d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:25.257757 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-8f01d85c-7a7e-4b47-87cb-94cd5471f7db req-7780ea11-5e0f-4241-8600-968dc62341b0 service nova] Creating event network-vif-deleted:7479245d-123e-46b1-91f6-427bf645d105 for instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 on hv-cinder-83538 Jul 26 17:14:25.265275 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-82fdd0ae-474e-49c2-9377-83f1babad26d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:25.265958 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-82fdd0ae-474e-49c2-9377-83f1babad26d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:25.266893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-82fdd0ae-474e-49c2-9377-83f1babad26d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:25.267498 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-82fdd0ae-474e-49c2-9377-83f1babad26d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:25.283091 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-8f01d85c-7a7e-4b47-87cb-94cd5471f7db req-7780ea11-5e0f-4241-8600-968dc62341b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088108 Jul 26 17:14:25.286630 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 93/179] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:25.675054 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-82fdd0ae-474e-49c2-9377-83f1babad26d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:25.692559 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-82fdd0ae-474e-49c2-9377-83f1babad26d tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1345 microversion: 2.1 time: 0.463490 Jul 26 17:14:25.693318 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 87/180] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:25 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1345 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:25.947439 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a5fa060b-7967-4eda-bf17-05e86f7ab716 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:25.949789 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a5fa060b-7967-4eda-bf17-05e86f7ab716 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:25.961298 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5fa060b-7967-4eda-bf17-05e86f7ab716 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:25.961896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5fa060b-7967-4eda-bf17-05e86f7ab716 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:25.962816 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5fa060b-7967-4eda-bf17-05e86f7ab716 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:25.963374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5fa060b-7967-4eda-bf17-05e86f7ab716 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:26.071118 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-3121f294-908a-4901-a03a-6e87f1af659a req-be3d48e3-69d0-4ac5-8dfb-53b8b6e4e461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2799ba4-de59-4849-85e7-d0aaf12578e1", "tag": "046c2444-d052-4814-b962-6109cd25ef6e"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:26.084222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-3121f294-908a-4901-a03a-6e87f1af659a req-be3d48e3-69d0-4ac5-8dfb-53b8b6e4e461 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:26.084674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-3121f294-908a-4901-a03a-6e87f1af659a req-be3d48e3-69d0-4ac5-8dfb-53b8b6e4e461 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:26.104338 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-3121f294-908a-4901-a03a-6e87f1af659a req-be3d48e3-69d0-4ac5-8dfb-53b8b6e4e461 service nova] Creating event network-changed:046c2444-d052-4814-b962-6109cd25ef6e for instance e2799ba4-de59-4849-85e7-d0aaf12578e1 on hv-cinder-83538 Jul 26 17:14:26.110735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-3121f294-908a-4901-a03a-6e87f1af659a req-be3d48e3-69d0-4ac5-8dfb-53b8b6e4e461 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045018 Jul 26 17:14:26.111743 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 88/181] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:14:26.201683 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a5fa060b-7967-4eda-bf17-05e86f7ab716 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:26.215187 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a5fa060b-7967-4eda-bf17-05e86f7ab716 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.275857 Jul 26 17:14:26.229817 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 94/182] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:25 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:26.719794 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1c7173a6-b171-4907-9c94-b058e667171e tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:26.720880 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1c7173a6-b171-4907-9c94-b058e667171e tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:26.731039 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c7173a6-b171-4907-9c94-b058e667171e tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:26.732275 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c7173a6-b171-4907-9c94-b058e667171e tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:26.734567 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c7173a6-b171-4907-9c94-b058e667171e tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:26.735277 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c7173a6-b171-4907-9c94-b058e667171e tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:26.796530 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c7173a6-b171-4907-9c94-b058e667171e tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:26.797100 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c7173a6-b171-4907-9c94-b058e667171e tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:26.797725 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.objects.instance [None req-1c7173a6-b171-4907-9c94-b058e667171e tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lazy-loading 'fault' on Instance uuid ce4766fe-3ad8-492b-a9b0-4dbd07758a75 {{(pid=118122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:14:26.867264 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1c7173a6-b171-4907-9c94-b058e667171e tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c8648de5544757aa1d91c0878c65d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25df8851ae9b4039a00a9a30366ac922', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:26.876815 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1c7173a6-b171-4907-9c94-b058e667171e tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 200 len: 1350 microversion: 2.1 time: 0.164608 Jul 26 17:14:26.877693 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 89/183] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:26 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 1350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:27.240370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-908fb729-5a12-4536-a448-9352d9aae794 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:27.241094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-908fb729-5a12-4536-a448-9352d9aae794 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:27.250216 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-908fb729-5a12-4536-a448-9352d9aae794 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:27.251408 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-908fb729-5a12-4536-a448-9352d9aae794 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:27.252262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-908fb729-5a12-4536-a448-9352d9aae794 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:27.253044 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-908fb729-5a12-4536-a448-9352d9aae794 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:27.418362 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-908fb729-5a12-4536-a448-9352d9aae794 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:27.426951 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-908fb729-5a12-4536-a448-9352d9aae794 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.194933 Jul 26 17:14:27.427911 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 95/184] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:27 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:27.906582 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f3ab8d81-3b9a-4634-88cb-b88d58f86141 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:27.907276 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-f3ab8d81-3b9a-4634-88cb-b88d58f86141 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:27.919725 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f3ab8d81-3b9a-4634-88cb-b88d58f86141 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:27.921148 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f3ab8d81-3b9a-4634-88cb-b88d58f86141 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:27.922211 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f3ab8d81-3b9a-4634-88cb-b88d58f86141 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:27.922662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f3ab8d81-3b9a-4634-88cb-b88d58f86141 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:27.947288 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-f3ab8d81-3b9a-4634-88cb-b88d58f86141 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] HTTP exception thrown: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f3ab8d81-3b9a-4634-88cb-b88d58f86141 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Request method failure captured: Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 HTTP/1.1 Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCjL5yRvPmnG1qdLIcZjyLq7MLMRW2Amv9Q-FfD8qP3TlNN2eSGW_kI5AsP1ursjeyzE_zf_25p535BPDq9c-Pt5k51DvTa3NXZOfc8hlPOfg2gvE2CLdYaI5086aIKWYobZ5GoBLq-LxWuX00H5ZVpY1WWXVk7D5VBc2pl_lqCRFo Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 25df8851ae9b4039a00a9a30366ac922 Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-DeleteServersTestJSON-1613291429 Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:14:27.953332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:14:27.954781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:14:27.954781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-DeleteServersTestJSON-1613291429 Jul 26 17:14:27.954781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 25df8851ae9b4039a00a9a30366ac922 Jul 26 17:14:27.954781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-DeleteServersTestJSON-1613291429 Jul 26 17:14:27.954781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-DeleteServersTestJSON-1613291429-project Jul 26 17:14:27.954781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:14:27.954781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:14:27.954781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: e7c8648de5544757aa1d91c0878c65d2 Jul 26 17:14:27.954781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-DeleteServersTestJSON-1613291429-project Jul 26 17:14:27.954781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:14:27.954781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:27.954781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': 'ce4766fe-3ad8-492b-a9b0-4dbd07758a75'} Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:14:27.955702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:27.957133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:27.958467 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f3ab8d81-3b9a-4634-88cb-b88d58f86141 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Returning 404 to user: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:14:27.959634 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-f3ab8d81-3b9a-4634-88cb-b88d58f86141 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 404 len: 111 microversion: 2.1 time: 0.058881 Jul 26 17:14:27.960611 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 90/185] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:27 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:14:28.169844 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0c20bfea-26d3-45e8-8399-c4e702784921 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:28.173605 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0c20bfea-26d3-45e8-8399-c4e702784921 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:28.182898 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c20bfea-26d3-45e8-8399-c4e702784921 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:28.183576 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c20bfea-26d3-45e8-8399-c4e702784921 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:28.184732 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c20bfea-26d3-45e8-8399-c4e702784921 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:28.187414 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c20bfea-26d3-45e8-8399-c4e702784921 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:28.213370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-0c20bfea-26d3-45e8-8399-c4e702784921 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] HTTP exception thrown: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0c20bfea-26d3-45e8-8399-c4e702784921 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Request method failure captured: Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75/os-volume_attachments HTTP/1.1 Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CCjL5yRvPmnG1qdLIcZjyLq7MLMRW2Amv9Q-FfD8qP3TlNN2eSGW_kI5AsP1ursjeyzE_zf_25p535BPDq9c-Pt5k51DvTa3NXZOfc8hlPOfg2gvE2CLdYaI5086aIKWYobZ5GoBLq-LxWuX00H5ZVpY1WWXVk7D5VBc2pl_lqCRFo Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 25df8851ae9b4039a00a9a30366ac922 Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-DeleteServersTestJSON-1613291429 Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:14:28.219374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:14:28.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:14:28.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-DeleteServersTestJSON-1613291429 Jul 26 17:14:28.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 25df8851ae9b4039a00a9a30366ac922 Jul 26 17:14:28.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-DeleteServersTestJSON-1613291429 Jul 26 17:14:28.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-DeleteServersTestJSON-1613291429-project Jul 26 17:14:28.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:14:28.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:14:28.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: e7c8648de5544757aa1d91c0878c65d2 Jul 26 17:14:28.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-DeleteServersTestJSON-1613291429-project Jul 26 17:14:28.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:14:28.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:28.227397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'server_id': 'ce4766fe-3ad8-492b-a9b0-4dbd07758a75'} Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:14:28.228836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:28.231534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:14:28.237019 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0c20bfea-26d3-45e8-8399-c4e702784921 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Returning 404 to user: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:14:28.237019 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0c20bfea-26d3-45e8-8399-c4e702784921 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.058711 Jul 26 17:14:28.237019 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 96/186] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:14:28 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:14:28.454159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-226241a6-719d-4285-8301-22c116425c89 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:28.455374 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-226241a6-719d-4285-8301-22c116425c89 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:28.472995 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-226241a6-719d-4285-8301-22c116425c89 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:28.474227 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-226241a6-719d-4285-8301-22c116425c89 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:28.475595 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-226241a6-719d-4285-8301-22c116425c89 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:28.476766 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-226241a6-719d-4285-8301-22c116425c89 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:28.733034 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-226241a6-719d-4285-8301-22c116425c89 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:28.746070 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-226241a6-719d-4285-8301-22c116425c89 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.299212 Jul 26 17:14:28.747162 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 91/187] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:28 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:29.565166 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d3510ae7-8745-42f9-ae4e-1c08b9b92305 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:29.565967 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d3510ae7-8745-42f9-ae4e-1c08b9b92305 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:29.574619 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3510ae7-8745-42f9-ae4e-1c08b9b92305 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:29.575061 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3510ae7-8745-42f9-ae4e-1c08b9b92305 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:29.575871 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3510ae7-8745-42f9-ae4e-1c08b9b92305 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:29.576426 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3510ae7-8745-42f9-ae4e-1c08b9b92305 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:29.591588 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-d3510ae7-8745-42f9-ae4e-1c08b9b92305 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] HTTP exception thrown: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d3510ae7-8745-42f9-ae4e-1c08b9b92305 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Request method failure captured: Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 HTTP/1.1 Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CCjL5yRvPmnG1qdLIcZjyLq7MLMRW2Amv9Q-FfD8qP3TlNN2eSGW_kI5AsP1ursjeyzE_zf_25p535BPDq9c-Pt5k51DvTa3NXZOfc8hlPOfg2gvE2CLdYaI5086aIKWYobZ5GoBLq-LxWuX00H5ZVpY1WWXVk7D5VBc2pl_lqCRFo Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 25df8851ae9b4039a00a9a30366ac922 Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-DeleteServersTestJSON-1613291429 Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:14:29.594333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:14:29.595641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:14:29.595641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-DeleteServersTestJSON-1613291429 Jul 26 17:14:29.595641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 25df8851ae9b4039a00a9a30366ac922 Jul 26 17:14:29.595641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-DeleteServersTestJSON-1613291429 Jul 26 17:14:29.595641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-DeleteServersTestJSON-1613291429-project Jul 26 17:14:29.595641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:14:29.595641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:14:29.595641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: e7c8648de5544757aa1d91c0878c65d2 Jul 26 17:14:29.595641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-DeleteServersTestJSON-1613291429-project Jul 26 17:14:29.595641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:14:29.595641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:29.595641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': 'ce4766fe-3ad8-492b-a9b0-4dbd07758a75'} Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:14:29.599449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:29.600899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:14:29.602301 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d3510ae7-8745-42f9-ae4e-1c08b9b92305 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Returning 404 to user: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:14:29.602301 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d3510ae7-8745-42f9-ae4e-1c08b9b92305 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 404 len: 111 microversion: 2.1 time: 0.035925 Jul 26 17:14:29.602301 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 97/188] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:14:29 2022] DELETE /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:14:29.604433 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-eff0cb99-b61b-4e82-a43f-d911ffa2a648 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:29.605080 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-eff0cb99-b61b-4e82-a43f-d911ffa2a648 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] [instance: ce4766fe-3ad8-492b-a9b0-4dbd07758a75] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:29.613155 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-eff0cb99-b61b-4e82-a43f-d911ffa2a648 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:29.613854 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-eff0cb99-b61b-4e82-a43f-d911ffa2a648 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:29.615060 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-eff0cb99-b61b-4e82-a43f-d911ffa2a648 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:29.615775 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-eff0cb99-b61b-4e82-a43f-d911ffa2a648 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:29.641827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-eff0cb99-b61b-4e82-a43f-d911ffa2a648 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] HTTP exception thrown: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-eff0cb99-b61b-4e82-a43f-d911ffa2a648 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Request method failure captured: Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 HTTP/1.1 Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCjL5yRvPmnG1qdLIcZjyLq7MLMRW2Amv9Q-FfD8qP3TlNN2eSGW_kI5AsP1ursjeyzE_zf_25p535BPDq9c-Pt5k51DvTa3NXZOfc8hlPOfg2gvE2CLdYaI5086aIKWYobZ5GoBLq-LxWuX00H5ZVpY1WWXVk7D5VBc2pl_lqCRFo Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 25df8851ae9b4039a00a9a30366ac922 Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-DeleteServersTestJSON-1613291429 Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:14:29.643378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:14:29.645636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25df8851ae9b4039a00a9a30366ac922"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:14:29.645636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-DeleteServersTestJSON-1613291429 Jul 26 17:14:29.645636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 25df8851ae9b4039a00a9a30366ac922 Jul 26 17:14:29.645636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-DeleteServersTestJSON-1613291429 Jul 26 17:14:29.645636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-DeleteServersTestJSON-1613291429-project Jul 26 17:14:29.645636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:14:29.645636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:14:29.645636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: e7c8648de5544757aa1d91c0878c65d2 Jul 26 17:14:29.645636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-DeleteServersTestJSON-1613291429-project Jul 26 17:14:29.645636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:14:29.645636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:29.645636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': 'ce4766fe-3ad8-492b-a9b0-4dbd07758a75'} Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:14:29.646887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. Jul 26 17:14:29.648234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:29.650728 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-eff0cb99-b61b-4e82-a43f-d911ffa2a648 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] Returning 404 to user: Instance ce4766fe-3ad8-492b-a9b0-4dbd07758a75 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:14:29.650728 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-eff0cb99-b61b-4e82-a43f-d911ffa2a648 tempest-DeleteServersTestJSON-1613291429 tempest-DeleteServersTestJSON-1613291429-project] 10.222.0.48 "GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75" status: 404 len: 111 microversion: 2.1 time: 0.044271 Jul 26 17:14:29.650728 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 92/189] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:29 2022] GET /compute/v2.1/servers/ce4766fe-3ad8-492b-a9b0-4dbd07758a75 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 17:14:29.778506 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a13e2e0f-07ba-478e-89dc-1d926321df8e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:29.780757 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a13e2e0f-07ba-478e-89dc-1d926321df8e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:29.788559 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a13e2e0f-07ba-478e-89dc-1d926321df8e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:29.789377 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a13e2e0f-07ba-478e-89dc-1d926321df8e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:29.790538 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a13e2e0f-07ba-478e-89dc-1d926321df8e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:29.791433 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a13e2e0f-07ba-478e-89dc-1d926321df8e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:30.358622 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a13e2e0f-07ba-478e-89dc-1d926321df8e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:30.384740 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a13e2e0f-07ba-478e-89dc-1d926321df8e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.610271 Jul 26 17:14:30.389236 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 98/190] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:29 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:31.421944 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a59f9959-b05d-416e-bafa-d45a1a662d1c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:31.424138 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a59f9959-b05d-416e-bafa-d45a1a662d1c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:31.431108 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a59f9959-b05d-416e-bafa-d45a1a662d1c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:31.437947 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a59f9959-b05d-416e-bafa-d45a1a662d1c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:31.439302 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a59f9959-b05d-416e-bafa-d45a1a662d1c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:31.442979 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a59f9959-b05d-416e-bafa-d45a1a662d1c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:31.673974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a59f9959-b05d-416e-bafa-d45a1a662d1c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:31.685785 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a59f9959-b05d-416e-bafa-d45a1a662d1c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.269352 Jul 26 17:14:31.689674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 93/191] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:31 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:32.707968 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4201412e-ef17-4d3c-81af-c73998782950 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:32.709226 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4201412e-ef17-4d3c-81af-c73998782950 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:32.717608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4201412e-ef17-4d3c-81af-c73998782950 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:32.718325 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4201412e-ef17-4d3c-81af-c73998782950 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:32.719304 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4201412e-ef17-4d3c-81af-c73998782950 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:32.719749 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4201412e-ef17-4d3c-81af-c73998782950 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:33.276608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4201412e-ef17-4d3c-81af-c73998782950 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:33.292135 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4201412e-ef17-4d3c-81af-c73998782950 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.587793 Jul 26 17:14:33.308445 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 99/192] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:32 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:34.320197 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-01fda19f-5fc7-4d37-a51e-0061c12fb546 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:34.320796 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-01fda19f-5fc7-4d37-a51e-0061c12fb546 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:34.356236 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-01fda19f-5fc7-4d37-a51e-0061c12fb546 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:34.358386 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-01fda19f-5fc7-4d37-a51e-0061c12fb546 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:34.359461 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-01fda19f-5fc7-4d37-a51e-0061c12fb546 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:34.360741 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-01fda19f-5fc7-4d37-a51e-0061c12fb546 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:34.562921 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-01fda19f-5fc7-4d37-a51e-0061c12fb546 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:34.573009 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-01fda19f-5fc7-4d37-a51e-0061c12fb546 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.256572 Jul 26 17:14:34.580853 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 94/193] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:34 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:35.615388 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9369a0d1-af75-4eae-bd1b-350cc201d749 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:35.615989 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9369a0d1-af75-4eae-bd1b-350cc201d749 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:35.624568 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9369a0d1-af75-4eae-bd1b-350cc201d749 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:35.625275 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9369a0d1-af75-4eae-bd1b-350cc201d749 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:35.626115 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9369a0d1-af75-4eae-bd1b-350cc201d749 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:35.626511 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9369a0d1-af75-4eae-bd1b-350cc201d749 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:35.804756 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9369a0d1-af75-4eae-bd1b-350cc201d749 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:35.815729 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9369a0d1-af75-4eae-bd1b-350cc201d749 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.206130 Jul 26 17:14:35.817477 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 100/194] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:35 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:36.839298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-36ef7c4c-5e03-49b4-8b49-d8d70caf866d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:36.840528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-36ef7c4c-5e03-49b4-8b49-d8d70caf866d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:36.843843 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=82 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:36.849516 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-36ef7c4c-5e03-49b4-8b49-d8d70caf866d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:36.849971 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-36ef7c4c-5e03-49b4-8b49-d8d70caf866d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:36.851689 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-36ef7c4c-5e03-49b4-8b49-d8d70caf866d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:36.852146 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-36ef7c4c-5e03-49b4-8b49-d8d70caf866d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:36.989527 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-36ef7c4c-5e03-49b4-8b49-d8d70caf866d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:36.997480 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-36ef7c4c-5e03-49b4-8b49-d8d70caf866d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.162703 Jul 26 17:14:36.999106 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 95/195] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:36 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:37.581545 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c80e4958-b54c-4560-915e-763c601e9391 tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] Calling method '.version_select at 0x7f6ca8bc2dc0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:37.637065 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c80e4958-b54c-4560-915e-763c601e9391 tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f9132cf9-9393-4caa-a1e4-010f8e8d44be" status: 200 len: 351 microversion: 2.1 time: 0.059288 Jul 26 17:14:37.637641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 101/196] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:14:37 2022] GET /compute/v2.1/os-volumes/f9132cf9-9393-4caa-a1e4-010f8e8d44be => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:38.022379 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-58110ae9-e6cd-4134-9ff1-7454d6ff3fa5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:38.024015 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-58110ae9-e6cd-4134-9ff1-7454d6ff3fa5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:38.055051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-58110ae9-e6cd-4134-9ff1-7454d6ff3fa5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:38.055901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-58110ae9-e6cd-4134-9ff1-7454d6ff3fa5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:38.057399 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-58110ae9-e6cd-4134-9ff1-7454d6ff3fa5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:38.062559 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-58110ae9-e6cd-4134-9ff1-7454d6ff3fa5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:38.260760 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-58110ae9-e6cd-4134-9ff1-7454d6ff3fa5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:38.269718 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-58110ae9-e6cd-4134-9ff1-7454d6ff3fa5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.253729 Jul 26 17:14:38.270411 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 96/197] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:38 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:38.742507 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-252466449", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "networks": [{"uuid": "e2c2f3df-9741-4745-95bc-01e6ade4adf9"}]}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:38.752405 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:38.805638 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] validate_networks() for [('e2c2f3df-9741-4745-95bc-01e6ade4adf9', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:14:39.178657 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b73304db-5d1f-4db3-9d54-1b2f5cd7b60b tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] Calling method '.version_select at 0x7f6ca941a5e0>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:39.193977 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:14:39.194438 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:14:39.194916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:14:39.195493 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:14:39.195920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:14:39.207158 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:39.207571 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:39.208487 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:39.208937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:39.228676 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Getting quotas for project 396220daaf3f4a89aab4007f746b96ea. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:14:39.231617 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b73304db-5d1f-4db3-9d54-1b2f5cd7b60b tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a0b6ad19-0212-4f6c-bff5-92b4b1ec57bd" status: 200 len: 350 microversion: 2.1 time: 0.056880 Jul 26 17:14:39.233376 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 97/198] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:14:39 2022] GET /compute/v2.1/os-volumes/a0b6ad19-0212-4f6c-bff5-92b4b1ec57bd => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:14:39.234567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Getting quotas for user 8ce2731e0c8647c2a7ea29a0569d2a1d and project 396220daaf3f4a89aab4007f746b96ea. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:14:39.247303 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:14:39.250177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:14:39.296924 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1f2c364c-5762-4b07-b7f9-c925b1d0fec1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:39.298074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1f2c364c-5762-4b07-b7f9-c925b1d0fec1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:39.301634 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fb7d0115-e6ab-44c1-a4d2-898d72a35b0f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564026 Jul 26 17:14:39.302473 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 102/199] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:14:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 17:14:39.309503 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1f2c364c-5762-4b07-b7f9-c925b1d0fec1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:39.310348 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1f2c364c-5762-4b07-b7f9-c925b1d0fec1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:39.311987 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1f2c364c-5762-4b07-b7f9-c925b1d0fec1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:39.313187 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1f2c364c-5762-4b07-b7f9-c925b1d0fec1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:39.315385 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-49b4539f-6577-44f6-a071-1fae4467d4f9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:39.317693 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-49b4539f-6577-44f6-a071-1fae4467d4f9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:39.396448 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-49b4539f-6577-44f6-a071-1fae4467d4f9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:39.411693 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-49b4539f-6577-44f6-a071-1fae4467d4f9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1213 microversion: 2.1 time: 0.101868 Jul 26 17:14:39.420774 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 103/200] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:39 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:39.543158 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1f2c364c-5762-4b07-b7f9-c925b1d0fec1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:39.553843 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1f2c364c-5762-4b07-b7f9-c925b1d0fec1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.264289 Jul 26 17:14:39.555050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 98/201] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:39 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:40.437726 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8853df7a-9cbc-4125-8d2c-c47e14adefa6 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:40.438450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8853df7a-9cbc-4125-8d2c-c47e14adefa6 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:40.445654 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8853df7a-9cbc-4125-8d2c-c47e14adefa6 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:40.446346 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8853df7a-9cbc-4125-8d2c-c47e14adefa6 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:40.447338 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8853df7a-9cbc-4125-8d2c-c47e14adefa6 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:40.448008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8853df7a-9cbc-4125-8d2c-c47e14adefa6 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:40.515809 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8853df7a-9cbc-4125-8d2c-c47e14adefa6 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:40.518021 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:40.524929 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8853df7a-9cbc-4125-8d2c-c47e14adefa6 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1265 microversion: 2.1 time: 0.094936 Jul 26 17:14:40.525531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 104/202] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:40 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:40.576745 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-159dd4a2-e994-459a-bfcf-c9e8ccfc1904 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:40.577510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-159dd4a2-e994-459a-bfcf-c9e8ccfc1904 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:40.584034 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-159dd4a2-e994-459a-bfcf-c9e8ccfc1904 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:40.584532 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-159dd4a2-e994-459a-bfcf-c9e8ccfc1904 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:40.585357 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-159dd4a2-e994-459a-bfcf-c9e8ccfc1904 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:40.585795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-159dd4a2-e994-459a-bfcf-c9e8ccfc1904 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:40.589894 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=100 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:40.791913 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-42bffc08-9af7-4ef5-8ad1-cf7aa25ce994 tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] Calling method '.version_select at 0x7f6ca8bb4a60>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:40.835778 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-159dd4a2-e994-459a-bfcf-c9e8ccfc1904 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:40.865109 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-42bffc08-9af7-4ef5-8ad1-cf7aa25ce994 tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e1a4d543-daec-4f11-ac86-839955aadf18" status: 200 len: 350 microversion: 2.1 time: 0.078594 Jul 26 17:14:40.865689 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 105/203] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:14:40 2022] GET /compute/v2.1/os-volumes/e1a4d543-daec-4f11-ac86-839955aadf18 => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:40.878721 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b6e95a8a-08ad-4b33-92d0-65f1e404c39e tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] Calling method '.version_select at 0x7f6ca8bc2160>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:40.885832 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-159dd4a2-e994-459a-bfcf-c9e8ccfc1904 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.314381 Jul 26 17:14:40.886955 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 99/204] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:40 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:40.979510 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b6e95a8a-08ad-4b33-92d0-65f1e404c39e tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.104679 Jul 26 17:14:40.980261 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 106/205] 10.222.0.48 () {58 vars in 1134 bytes} [Tue Jul 26 17:14:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:40.995243 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e3e23113-bb3a-432b-875e-8142b48ad70b tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] Calling method '.version_select at 0x7f6ca941ac10>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:41.094898 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e3e23113-bb3a-432b-875e-8142b48ad70b tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.103414 Jul 26 17:14:41.095531 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 100/206] 10.222.0.48 () {58 vars in 1149 bytes} [Tue Jul 26 17:14:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:41.108801 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d86bdad7-5bd2-4521-929f-d865c6c0a398 tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] Calling method '.version_select at 0x7f6ca8b64940>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:41.215976 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d86bdad7-5bd2-4521-929f-d865c6c0a398 tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.110103 Jul 26 17:14:41.217139 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 107/207] 10.222.0.48 () {58 vars in 1134 bytes} [Tue Jul 26 17:14:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:41.236206 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c1c8ffbd-bc8f-4432-977c-cac9c67dc3a1 tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] Calling method '.version_select at 0x7f6ca94363a0>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:41.477960 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c1c8ffbd-bc8f-4432-977c-cac9c67dc3a1 tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.249771 Jul 26 17:14:41.478763 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 101/208] 10.222.0.48 () {58 vars in 1167 bytes} [Tue Jul 26 17:14:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:41.495981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f3c39d88-9ab4-4ade-9ebb-a4bc66ef38e1 tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] Calling method '.version_select at 0x7f6ca8b64550>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:41.547962 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7eb61891-2cf1-4ebc-85f5-211e5cc558ee tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:41.548953 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7eb61891-2cf1-4ebc-85f5-211e5cc558ee tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:41.556669 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7eb61891-2cf1-4ebc-85f5-211e5cc558ee tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:41.557498 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7eb61891-2cf1-4ebc-85f5-211e5cc558ee tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:41.558505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7eb61891-2cf1-4ebc-85f5-211e5cc558ee tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:41.559200 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7eb61891-2cf1-4ebc-85f5-211e5cc558ee tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:41.645611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f3c39d88-9ab4-4ade-9ebb-a4bc66ef38e1 tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.156329 Jul 26 17:14:41.646306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 108/209] 10.222.0.48 () {58 vars in 1170 bytes} [Tue Jul 26 17:14:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:41.651870 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7eb61891-2cf1-4ebc-85f5-211e5cc558ee tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:41.660805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-09d43bdf-5d98-4828-80b3-ebffed55ea5d tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] Calling method '.version_select at 0x7f6ca8ce79d0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:41.661801 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7eb61891-2cf1-4ebc-85f5-211e5cc558ee tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1271 microversion: 2.1 time: 0.118523 Jul 26 17:14:41.662381 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 102/210] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:41 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:41.758432 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-09d43bdf-5d98-4828-80b3-ebffed55ea5d tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.101930 Jul 26 17:14:41.759288 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 109/211] 10.222.0.48 () {58 vars in 1155 bytes} [Tue Jul 26 17:14:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:41.778297 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8b856feb-f82a-4fef-9c69-d61499803f42 tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] Calling method '.version_select at 0x7f6ca942ca60>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:41.908634 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8b856feb-f82a-4fef-9c69-d61499803f42 tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.135408 Jul 26 17:14:41.910237 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 103/212] 10.222.0.48 () {58 vars in 1188 bytes} [Tue Jul 26 17:14:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:41.924788 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6fa94cb2-bb07-4674-89fd-baff77c5a4ea tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:41.925519 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6fa94cb2-bb07-4674-89fd-baff77c5a4ea tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:41.929090 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ab1e66d8-aa7d-48b2-9294-d93372a0d32b tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] Calling method '.version_select at 0x7f6ca941ad30>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:41.933368 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fa94cb2-bb07-4674-89fd-baff77c5a4ea tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:41.933955 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fa94cb2-bb07-4674-89fd-baff77c5a4ea tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:41.934878 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fa94cb2-bb07-4674-89fd-baff77c5a4ea tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:41.935999 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fa94cb2-bb07-4674-89fd-baff77c5a4ea tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:42.123528 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6fa94cb2-bb07-4674-89fd-baff77c5a4ea tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:42.132088 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6fa94cb2-bb07-4674-89fd-baff77c5a4ea tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.225151 Jul 26 17:14:42.133028 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 110/213] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:41 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:42.193225 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ab1e66d8-aa7d-48b2-9294-d93372a0d32b tempest-VolumesTestJSON-749680335 tempest-VolumesTestJSON-749680335-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.267941 Jul 26 17:14:42.194245 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 104/214] 10.222.0.48 () {58 vars in 1155 bytes} [Tue Jul 26 17:14:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:42.691317 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-76af58ae-1ba6-49ee-9f2a-3d2e785aceeb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:42.692460 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-76af58ae-1ba6-49ee-9f2a-3d2e785aceeb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:42.705458 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76af58ae-1ba6-49ee-9f2a-3d2e785aceeb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:42.706476 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76af58ae-1ba6-49ee-9f2a-3d2e785aceeb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:42.708470 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76af58ae-1ba6-49ee-9f2a-3d2e785aceeb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:42.709731 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76af58ae-1ba6-49ee-9f2a-3d2e785aceeb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:42.913954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-76af58ae-1ba6-49ee-9f2a-3d2e785aceeb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:42.928000 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-76af58ae-1ba6-49ee-9f2a-3d2e785aceeb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1313 microversion: 2.1 time: 0.245354 Jul 26 17:14:42.929016 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 111/215] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:42 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:43.157879 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7ac5a301-ef83-421e-acc6-29264c34f338 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:43.158608 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7ac5a301-ef83-421e-acc6-29264c34f338 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:43.170835 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7ac5a301-ef83-421e-acc6-29264c34f338 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:43.172017 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7ac5a301-ef83-421e-acc6-29264c34f338 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:43.173920 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7ac5a301-ef83-421e-acc6-29264c34f338 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:43.174733 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7ac5a301-ef83-421e-acc6-29264c34f338 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:43.184395 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-464e6c88-6d09-464a-8775-b1c4847992aa req-1fce0e04-a76b-4374-b0d5-0d50c000b1ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4a19ce-2ae7-4b7a-b890-425016076a2f", "tag": "9c58cc9a-8131-40de-bb58-ec5929919e44"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:43.208004 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-464e6c88-6d09-464a-8775-b1c4847992aa req-1fce0e04-a76b-4374-b0d5-0d50c000b1ed service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:43.208501 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-464e6c88-6d09-464a-8775-b1c4847992aa req-1fce0e04-a76b-4374-b0d5-0d50c000b1ed service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:43.237047 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-464e6c88-6d09-464a-8775-b1c4847992aa req-1fce0e04-a76b-4374-b0d5-0d50c000b1ed service nova] Creating event network-changed:9c58cc9a-8131-40de-bb58-ec5929919e44 for instance 0d4a19ce-2ae7-4b7a-b890-425016076a2f on hv-cinder-83538 Jul 26 17:14:43.246533 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-464e6c88-6d09-464a-8775-b1c4847992aa req-1fce0e04-a76b-4374-b0d5-0d50c000b1ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068487 Jul 26 17:14:43.249082 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 112/216] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:43.504945 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7ac5a301-ef83-421e-acc6-29264c34f338 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:43.526339 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7ac5a301-ef83-421e-acc6-29264c34f338 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.374016 Jul 26 17:14:43.528453 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 105/217] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:43 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:43.957537 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-45615616-3517-411f-af96-b701e839a3b2 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:43.958641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-45615616-3517-411f-af96-b701e839a3b2 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:43.967310 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45615616-3517-411f-af96-b701e839a3b2 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:43.968283 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45615616-3517-411f-af96-b701e839a3b2 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:43.969337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45615616-3517-411f-af96-b701e839a3b2 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:43.970254 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45615616-3517-411f-af96-b701e839a3b2 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:44.153682 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-45615616-3517-411f-af96-b701e839a3b2 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:44.162952 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-45615616-3517-411f-af96-b701e839a3b2 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1313 microversion: 2.1 time: 0.211158 Jul 26 17:14:44.163551 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 113/218] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:43 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:44.551194 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b41cd913-df84-4896-80cb-374316c2cd66 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:44.551814 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b41cd913-df84-4896-80cb-374316c2cd66 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:44.558171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b41cd913-df84-4896-80cb-374316c2cd66 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:44.558623 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b41cd913-df84-4896-80cb-374316c2cd66 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:44.559407 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b41cd913-df84-4896-80cb-374316c2cd66 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:44.559868 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b41cd913-df84-4896-80cb-374316c2cd66 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:44.741475 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-b41cd913-df84-4896-80cb-374316c2cd66 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:44.751273 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b41cd913-df84-4896-80cb-374316c2cd66 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.204899 Jul 26 17:14:44.752181 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 106/219] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:44 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:45.184871 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-284f32dc-29c2-4685-97ee-8ade6994e48f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:45.186109 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-284f32dc-29c2-4685-97ee-8ade6994e48f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:45.192325 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-284f32dc-29c2-4685-97ee-8ade6994e48f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:45.192770 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-284f32dc-29c2-4685-97ee-8ade6994e48f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:45.193563 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-284f32dc-29c2-4685-97ee-8ade6994e48f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:45.194203 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-284f32dc-29c2-4685-97ee-8ade6994e48f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:45.372738 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-284f32dc-29c2-4685-97ee-8ade6994e48f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:45.384766 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-284f32dc-29c2-4685-97ee-8ade6994e48f tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1313 microversion: 2.1 time: 0.203596 Jul 26 17:14:45.393010 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 114/220] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:45 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:45.774418 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-66a8b2be-d948-4252-901e-d9f0ad14c83e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:45.775194 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-66a8b2be-d948-4252-901e-d9f0ad14c83e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:45.781748 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-66a8b2be-d948-4252-901e-d9f0ad14c83e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:45.782181 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-66a8b2be-d948-4252-901e-d9f0ad14c83e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:45.783227 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-66a8b2be-d948-4252-901e-d9f0ad14c83e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:45.783661 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-66a8b2be-d948-4252-901e-d9f0ad14c83e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:45.998196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-66a8b2be-d948-4252-901e-d9f0ad14c83e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:46.014646 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-66a8b2be-d948-4252-901e-d9f0ad14c83e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.243556 Jul 26 17:14:46.016162 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 107/221] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:45 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:46.408175 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9ce23e5d-a38c-420e-9f64-d67d82117803 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:46.408804 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9ce23e5d-a38c-420e-9f64-d67d82117803 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:46.419058 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ce23e5d-a38c-420e-9f64-d67d82117803 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:46.420400 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ce23e5d-a38c-420e-9f64-d67d82117803 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:46.421501 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ce23e5d-a38c-420e-9f64-d67d82117803 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:46.421942 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ce23e5d-a38c-420e-9f64-d67d82117803 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:46.598943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9ce23e5d-a38c-420e-9f64-d67d82117803 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:46.612093 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9ce23e5d-a38c-420e-9f64-d67d82117803 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1313 microversion: 2.1 time: 0.208896 Jul 26 17:14:46.613822 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 115/222] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:46 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:47.041550 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7b5d34db-81ad-46d8-8d8a-ac66352dac3c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:47.042329 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7b5d34db-81ad-46d8-8d8a-ac66352dac3c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:47.065887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7b5d34db-81ad-46d8-8d8a-ac66352dac3c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:47.066664 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7b5d34db-81ad-46d8-8d8a-ac66352dac3c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:47.072047 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7b5d34db-81ad-46d8-8d8a-ac66352dac3c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:47.073205 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7b5d34db-81ad-46d8-8d8a-ac66352dac3c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:47.382214 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7b5d34db-81ad-46d8-8d8a-ac66352dac3c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:47.402276 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7b5d34db-81ad-46d8-8d8a-ac66352dac3c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.364571 Jul 26 17:14:47.402276 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 108/223] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:47 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:47.637995 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4409595d-d684-4a06-a9e9-5f14ab53db3a tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:47.639394 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4409595d-d684-4a06-a9e9-5f14ab53db3a tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:47.651387 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4409595d-d684-4a06-a9e9-5f14ab53db3a tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:47.652194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4409595d-d684-4a06-a9e9-5f14ab53db3a tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:47.653685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4409595d-d684-4a06-a9e9-5f14ab53db3a tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:47.655694 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4409595d-d684-4a06-a9e9-5f14ab53db3a tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:47.845671 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4409595d-d684-4a06-a9e9-5f14ab53db3a tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:47.859545 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4409595d-d684-4a06-a9e9-5f14ab53db3a tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1313 microversion: 2.1 time: 0.227531 Jul 26 17:14:47.860385 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 116/224] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:47 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:48.329238 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-c53f8869-a870-4dc7-87fb-be1ec79883bd req-a3234ce8-504b-4f51-90ea-15344f80ec87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4a19ce-2ae7-4b7a-b890-425016076a2f", "name": "network-vif-plugged", "status": "completed", "tag": "9c58cc9a-8131-40de-bb58-ec5929919e44"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:48.339574 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-c53f8869-a870-4dc7-87fb-be1ec79883bd req-a3234ce8-504b-4f51-90ea-15344f80ec87 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:48.340180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-c53f8869-a870-4dc7-87fb-be1ec79883bd req-a3234ce8-504b-4f51-90ea-15344f80ec87 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:48.354523 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-c53f8869-a870-4dc7-87fb-be1ec79883bd req-a3234ce8-504b-4f51-90ea-15344f80ec87 service nova] Creating event network-vif-plugged:9c58cc9a-8131-40de-bb58-ec5929919e44 for instance 0d4a19ce-2ae7-4b7a-b890-425016076a2f on hv-cinder-83538 Jul 26 17:14:48.360737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-c53f8869-a870-4dc7-87fb-be1ec79883bd req-a3234ce8-504b-4f51-90ea-15344f80ec87 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036106 Jul 26 17:14:48.361609 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 109/225] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:48.423633 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0d05bb27-c824-4db4-941d-d093f678fd16 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:48.424364 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0d05bb27-c824-4db4-941d-d093f678fd16 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:48.431430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d05bb27-c824-4db4-941d-d093f678fd16 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:48.432101 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d05bb27-c824-4db4-941d-d093f678fd16 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:48.432804 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d05bb27-c824-4db4-941d-d093f678fd16 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:48.433271 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d05bb27-c824-4db4-941d-d093f678fd16 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:48.604162 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0d05bb27-c824-4db4-941d-d093f678fd16 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:48.618906 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0d05bb27-c824-4db4-941d-d093f678fd16 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1523 microversion: 2.1 time: 0.201695 Jul 26 17:14:48.619910 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 117/226] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:48 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:48.892527 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c51b3032-1c5d-42cf-8e72-9e18bde4d008 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:48.893447 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c51b3032-1c5d-42cf-8e72-9e18bde4d008 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:48.903378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c51b3032-1c5d-42cf-8e72-9e18bde4d008 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:48.905491 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c51b3032-1c5d-42cf-8e72-9e18bde4d008 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:48.906947 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c51b3032-1c5d-42cf-8e72-9e18bde4d008 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:48.907688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c51b3032-1c5d-42cf-8e72-9e18bde4d008 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:49.112299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c51b3032-1c5d-42cf-8e72-9e18bde4d008 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:49.121568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c51b3032-1c5d-42cf-8e72-9e18bde4d008 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1313 microversion: 2.1 time: 0.235765 Jul 26 17:14:49.122257 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 110/227] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:48 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:49.643332 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-97e7b9e5-b17e-4101-9fa2-9f3d58d282b4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:49.644039 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-97e7b9e5-b17e-4101-9fa2-9f3d58d282b4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:49.646875 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:49.647994 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=8 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:49.654781 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97e7b9e5-b17e-4101-9fa2-9f3d58d282b4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:49.655229 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97e7b9e5-b17e-4101-9fa2-9f3d58d282b4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:49.655996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97e7b9e5-b17e-4101-9fa2-9f3d58d282b4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:49.656419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97e7b9e5-b17e-4101-9fa2-9f3d58d282b4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:49.974312 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-97e7b9e5-b17e-4101-9fa2-9f3d58d282b4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:49.983955 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-97e7b9e5-b17e-4101-9fa2-9f3d58d282b4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1503 microversion: 2.1 time: 0.345330 Jul 26 17:14:49.984820 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 118/228] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:49 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1503 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:50.004857 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a97281d9-9692-45e1-b5a3-381d55e2275a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:50.005907 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a97281d9-9692-45e1-b5a3-381d55e2275a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:50.012217 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a97281d9-9692-45e1-b5a3-381d55e2275a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:50.012675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a97281d9-9692-45e1-b5a3-381d55e2275a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:50.015026 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a97281d9-9692-45e1-b5a3-381d55e2275a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:50.016718 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a97281d9-9692-45e1-b5a3-381d55e2275a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:50.143613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b9f03341-1c1f-43bc-bd84-9680639dce19 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:50.144129 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b9f03341-1c1f-43bc-bd84-9680639dce19 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:50.150933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9f03341-1c1f-43bc-bd84-9680639dce19 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:50.151383 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9f03341-1c1f-43bc-bd84-9680639dce19 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:50.152387 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9f03341-1c1f-43bc-bd84-9680639dce19 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:50.152827 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9f03341-1c1f-43bc-bd84-9680639dce19 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:50.170402 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a97281d9-9692-45e1-b5a3-381d55e2275a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:50.178424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a97281d9-9692-45e1-b5a3-381d55e2275a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1515 microversion: 2.1 time: 0.177304 Jul 26 17:14:50.179201 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 111/229] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:49 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:50.338883 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b9f03341-1c1f-43bc-bd84-9680639dce19 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:50.382504 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b9f03341-1c1f-43bc-bd84-9680639dce19 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1313 microversion: 2.1 time: 0.242867 Jul 26 17:14:50.383462 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 119/230] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:50 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:51.409544 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a21fb2ee-d43d-4a1b-bb57-ce21c61113b0 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:51.410381 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a21fb2ee-d43d-4a1b-bb57-ce21c61113b0 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:51.417577 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a21fb2ee-d43d-4a1b-bb57-ce21c61113b0 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:51.418027 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a21fb2ee-d43d-4a1b-bb57-ce21c61113b0 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:51.418798 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a21fb2ee-d43d-4a1b-bb57-ce21c61113b0 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:51.419229 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a21fb2ee-d43d-4a1b-bb57-ce21c61113b0 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:51.581159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a21fb2ee-d43d-4a1b-bb57-ce21c61113b0 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:51.589925 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a21fb2ee-d43d-4a1b-bb57-ce21c61113b0 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1496 microversion: 2.1 time: 0.187091 Jul 26 17:14:51.590584 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 112/231] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:51 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1496 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:51.704443 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1829733f-e4d2-42a9-bbaa-6e1be2df4efd tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:51.706914 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1829733f-e4d2-42a9-bbaa-6e1be2df4efd tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:51.713552 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1829733f-e4d2-42a9-bbaa-6e1be2df4efd tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:51.714008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1829733f-e4d2-42a9-bbaa-6e1be2df4efd tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:51.714791 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1829733f-e4d2-42a9-bbaa-6e1be2df4efd tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:51.715231 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1829733f-e4d2-42a9-bbaa-6e1be2df4efd tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:51.740181 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-1829733f-e4d2-42a9-bbaa-6e1be2df4efd tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lazy-loading 'flavor' on Instance uuid 9254cf15-b0da-432c-81a4-a9b981a7eda1 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:14:51.820565 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1829733f-e4d2-42a9-bbaa-6e1be2df4efd tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "POST /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1/action" status: 200 len: 32 microversion: 2.1 time: 0.120604 Jul 26 17:14:51.821470 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 120/232] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:14:51 2022] POST /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1/action => generated 32 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 17:14:51.831299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3ee2455d-e149-4623-92da-3efb980dfa30 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:51.832076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3ee2455d-e149-4623-92da-3efb980dfa30 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:51.838175 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3ee2455d-e149-4623-92da-3efb980dfa30 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:51.838888 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3ee2455d-e149-4623-92da-3efb980dfa30 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:51.839715 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3ee2455d-e149-4623-92da-3efb980dfa30 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:51.840313 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3ee2455d-e149-4623-92da-3efb980dfa30 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:52.132704 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3ee2455d-e149-4623-92da-3efb980dfa30 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:52.146480 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3ee2455d-e149-4623-92da-3efb980dfa30 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.318186 Jul 26 17:14:52.150363 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 113/233] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:51 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:52.417519 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f24da7fe-b401-4009-a532-858c267779b4 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:52.419165 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f24da7fe-b401-4009-a532-858c267779b4 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:52.433872 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f24da7fe-b401-4009-a532-858c267779b4 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:52.434885 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f24da7fe-b401-4009-a532-858c267779b4 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:52.437151 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f24da7fe-b401-4009-a532-858c267779b4 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:52.437986 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f24da7fe-b401-4009-a532-858c267779b4 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:52.478890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f24da7fe-b401-4009-a532-858c267779b4 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:14:52.629568 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f24da7fe-b401-4009-a532-858c267779b4 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 204 len: 0 microversion: 2.1 time: 0.227284 Jul 26 17:14:52.631481 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 121/234] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:14:52 2022] DELETE /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:14:52.648077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d430f1d9-318b-480e-9737-89eb718a5321 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:52.649226 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d430f1d9-318b-480e-9737-89eb718a5321 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:52.658254 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d430f1d9-318b-480e-9737-89eb718a5321 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:52.658971 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d430f1d9-318b-480e-9737-89eb718a5321 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:52.659956 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d430f1d9-318b-480e-9737-89eb718a5321 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:52.660858 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d430f1d9-318b-480e-9737-89eb718a5321 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:52.901693 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d430f1d9-318b-480e-9737-89eb718a5321 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:52.911412 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d430f1d9-318b-480e-9737-89eb718a5321 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1502 microversion: 2.1 time: 0.273418 Jul 26 17:14:52.912020 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 114/235] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:52 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1502 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:53.176074 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-88f0c936-0830-47f6-a9d8-f969785a060e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:53.177400 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-88f0c936-0830-47f6-a9d8-f969785a060e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:53.186900 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88f0c936-0830-47f6-a9d8-f969785a060e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:53.187412 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88f0c936-0830-47f6-a9d8-f969785a060e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:53.188262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88f0c936-0830-47f6-a9d8-f969785a060e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:53.188808 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88f0c936-0830-47f6-a9d8-f969785a060e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:53.377155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-88f0c936-0830-47f6-a9d8-f969785a060e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:53.385444 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-88f0c936-0830-47f6-a9d8-f969785a060e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.216973 Jul 26 17:14:53.386340 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 122/236] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:53 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:53.934250 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-34387dc5-6642-4943-b290-4e0c6f68266c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:53.937199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-34387dc5-6642-4943-b290-4e0c6f68266c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:53.944483 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-34387dc5-6642-4943-b290-4e0c6f68266c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:53.945240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-34387dc5-6642-4943-b290-4e0c6f68266c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:53.946377 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-34387dc5-6642-4943-b290-4e0c6f68266c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:53.946826 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-34387dc5-6642-4943-b290-4e0c6f68266c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:54.202116 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-34387dc5-6642-4943-b290-4e0c6f68266c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:54.214373 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-34387dc5-6642-4943-b290-4e0c6f68266c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1502 microversion: 2.1 time: 0.286453 Jul 26 17:14:54.215881 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 115/237] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:53 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1502 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:54.413083 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7ba2e6cf-b890-432a-9cc3-c88bc91ad680 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:54.414765 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7ba2e6cf-b890-432a-9cc3-c88bc91ad680 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:54.421793 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ba2e6cf-b890-432a-9cc3-c88bc91ad680 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:54.422271 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ba2e6cf-b890-432a-9cc3-c88bc91ad680 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:54.423185 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ba2e6cf-b890-432a-9cc3-c88bc91ad680 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:54.423448 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ba2e6cf-b890-432a-9cc3-c88bc91ad680 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:54.443691 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:14:54.664130 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7ba2e6cf-b890-432a-9cc3-c88bc91ad680 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:54.673460 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7ba2e6cf-b890-432a-9cc3-c88bc91ad680 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.269801 Jul 26 17:14:54.674062 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 123/238] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:54 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:55.254913 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-13244bc3-a78b-48a7-b6e0-da86f4a72844 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:55.256443 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-13244bc3-a78b-48a7-b6e0-da86f4a72844 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:55.265308 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-13244bc3-a78b-48a7-b6e0-da86f4a72844 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:55.266301 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-13244bc3-a78b-48a7-b6e0-da86f4a72844 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:55.267990 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-13244bc3-a78b-48a7-b6e0-da86f4a72844 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:55.268786 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-13244bc3-a78b-48a7-b6e0-da86f4a72844 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:55.594627 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-e4d6eb01-9f49-41cb-9dab-6d78a8bb6f01 req-f31c5fed-2d90-422d-abd8-fa5b53a51897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4a19ce-2ae7-4b7a-b890-425016076a2f", "name": "network-vif-deleted", "tag": "9c58cc9a-8131-40de-bb58-ec5929919e44"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:55.617314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e4d6eb01-9f49-41cb-9dab-6d78a8bb6f01 req-f31c5fed-2d90-422d-abd8-fa5b53a51897 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:55.617938 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e4d6eb01-9f49-41cb-9dab-6d78a8bb6f01 req-f31c5fed-2d90-422d-abd8-fa5b53a51897 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:55.628677 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-13244bc3-a78b-48a7-b6e0-da86f4a72844 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:55.631677 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-e4d6eb01-9f49-41cb-9dab-6d78a8bb6f01 req-f31c5fed-2d90-422d-abd8-fa5b53a51897 service nova] Creating event network-vif-deleted:9c58cc9a-8131-40de-bb58-ec5929919e44 for instance 0d4a19ce-2ae7-4b7a-b890-425016076a2f on hv-cinder-83538 Jul 26 17:14:55.638715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-e4d6eb01-9f49-41cb-9dab-6d78a8bb6f01 req-f31c5fed-2d90-422d-abd8-fa5b53a51897 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050553 Jul 26 17:14:55.640421 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 124/239] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:14:55.643395 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-13244bc3-a78b-48a7-b6e0-da86f4a72844 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 200 len: 1502 microversion: 2.1 time: 0.391530 Jul 26 17:14:55.644357 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 116/240] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:55 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 1502 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:55.699505 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2d556b28-de0c-44b7-aac9-f60b6fae71e7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:55.703530 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2d556b28-de0c-44b7-aac9-f60b6fae71e7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:55.710107 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d556b28-de0c-44b7-aac9-f60b6fae71e7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:55.710563 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d556b28-de0c-44b7-aac9-f60b6fae71e7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:55.711347 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d556b28-de0c-44b7-aac9-f60b6fae71e7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:55.711791 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d556b28-de0c-44b7-aac9-f60b6fae71e7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:55.870480 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2d556b28-de0c-44b7-aac9-f60b6fae71e7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:55.881671 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2d556b28-de0c-44b7-aac9-f60b6fae71e7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.188783 Jul 26 17:14:55.882277 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 125/241] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:55 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:56.670342 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3c4a4f5b-ecb3-4ae5-a122-60b3c66a32d8 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:56.671454 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3c4a4f5b-ecb3-4ae5-a122-60b3c66a32d8 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 0d4a19ce-2ae7-4b7a-b890-425016076a2f] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:56.681321 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3c4a4f5b-ecb3-4ae5-a122-60b3c66a32d8 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:56.681931 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3c4a4f5b-ecb3-4ae5-a122-60b3c66a32d8 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:56.683294 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3c4a4f5b-ecb3-4ae5-a122-60b3c66a32d8 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:56.683980 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3c4a4f5b-ecb3-4ae5-a122-60b3c66a32d8 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:56.708480 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-3c4a4f5b-ecb3-4ae5-a122-60b3c66a32d8 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] HTTP exception thrown: Instance 0d4a19ce-2ae7-4b7a-b890-425016076a2f could not be found. Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3c4a4f5b-ecb3-4ae5-a122-60b3c66a32d8 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Request method failure captured: Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f HTTP/1.1 Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CD7u5jW6q36j6TOgRRr0NhXV6NfqSCyht-d4XwXZobEGrGk-LlxLN90h0icWfcJEwuWNInKd-q9J4ZpJor7JnuaHTA5CRXXcFQqaTLeLpgy5_KGUhYlgSVN1U4s82t-YsH1kmC6CWrUXMKighsfsSvOwoEJd_EQfEnJyynsLdN3EXk Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 396220daaf3f4a89aab4007f746b96ea Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-VolumesActionsTest-1138942481 Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:14:56.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:14:56.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/396220daaf3f4a89aab4007f746b96ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_396220daaf3f4a89aab4007f746b96ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/396220daaf3f4a89aab4007f746b96ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/396220daaf3f4a89aab4007f746b96ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:14:56.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-VolumesActionsTest-1138942481 Jul 26 17:14:56.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 396220daaf3f4a89aab4007f746b96ea Jul 26 17:14:56.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-VolumesActionsTest-1138942481 Jul 26 17:14:56.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-VolumesActionsTest-1138942481-project Jul 26 17:14:56.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:14:56.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:14:56.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: 8ce2731e0c8647c2a7ea29a0569d2a1d Jul 26 17:14:56.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-VolumesActionsTest-1138942481-project Jul 26 17:14:56.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:14:56.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 0d4a19ce-2ae7-4b7a-b890-425016076a2f could not be found. Jul 26 17:14:56.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '0d4a19ce-2ae7-4b7a-b890-425016076a2f'} Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d4a19ce-2ae7-4b7a-b890-425016076a2f could not be found. Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:14:56.714561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d4a19ce-2ae7-4b7a-b890-425016076a2f could not be found. Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d4a19ce-2ae7-4b7a-b890-425016076a2f could not be found. Jul 26 17:14:56.718247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:14:56.721645 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3c4a4f5b-ecb3-4ae5-a122-60b3c66a32d8 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Returning 404 to user: Instance 0d4a19ce-2ae7-4b7a-b890-425016076a2f could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:14:56.723059 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3c4a4f5b-ecb3-4ae5-a122-60b3c66a32d8 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f" status: 404 len: 111 microversion: 2.1 time: 0.060992 Jul 26 17:14:56.724016 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 117/242] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:56 2022] GET /compute/v2.1/servers/0d4a19ce-2ae7-4b7a-b890-425016076a2f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:14:56.912242 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-05b0c605-45f7-40aa-812d-198ff268bde2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:56.913055 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-05b0c605-45f7-40aa-812d-198ff268bde2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:56.924952 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05b0c605-45f7-40aa-812d-198ff268bde2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:56.926435 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05b0c605-45f7-40aa-812d-198ff268bde2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:56.928037 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05b0c605-45f7-40aa-812d-198ff268bde2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:56.930175 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05b0c605-45f7-40aa-812d-198ff268bde2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:56.960582 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1479402184", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "networks": [{"uuid": "e2c2f3df-9741-4745-95bc-01e6ade4adf9"}]}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:14:57.038983 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.network.neutron [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] validate_networks() for [('e2c2f3df-9741-4745-95bc-01e6ade4adf9', None, None, None, None, None)] {{(pid=118122) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:14:57.197459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-05b0c605-45f7-40aa-812d-198ff268bde2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:57.218461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-05b0c605-45f7-40aa-812d-198ff268bde2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.314688 Jul 26 17:14:57.220160 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 126/243] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:56 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:57.536600 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Flavor limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:14:57.537059 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Image limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:14:57.537532 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Flavor pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:14:57.538174 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Image pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:14:57.538783 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:14:57.549303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:57.549913 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:57.551049 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:57.551049 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:57.577015 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Getting quotas for project 396220daaf3f4a89aab4007f746b96ea. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:14:57.581579 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Getting quotas for user 8ce2731e0c8647c2a7ea29a0569d2a1d and project 396220daaf3f4a89aab4007f746b96ea. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:14:57.596370 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Going to run 1 instances... {{(pid=118122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:14:57.598806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:14:57.652712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b618e437-e858-47a1-b809-9ee6da54b42c tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695629 Jul 26 17:14:57.654874 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 118/244] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:14:57.676370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-77ce3ba9-4f40-435c-b43f-43db8e114aab tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:57.677546 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-77ce3ba9-4f40-435c-b43f-43db8e114aab tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:57.769983 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-77ce3ba9-4f40-435c-b43f-43db8e114aab tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:57.783570 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-77ce3ba9-4f40-435c-b43f-43db8e114aab tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1214 microversion: 2.1 time: 0.118410 Jul 26 17:14:57.785087 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 127/245] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:57 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:58.244397 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-aaba7159-64cc-4240-8213-f4de197bb465 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:58.248056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-aaba7159-64cc-4240-8213-f4de197bb465 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:58.270670 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aaba7159-64cc-4240-8213-f4de197bb465 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:58.271363 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aaba7159-64cc-4240-8213-f4de197bb465 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:58.276981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aaba7159-64cc-4240-8213-f4de197bb465 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:58.278098 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aaba7159-64cc-4240-8213-f4de197bb465 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:58.516938 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-aaba7159-64cc-4240-8213-f4de197bb465 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:58.526434 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-aaba7159-64cc-4240-8213-f4de197bb465 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.288369 Jul 26 17:14:58.527278 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 119/246] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:58 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:58.814037 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7605c465-336c-4b9a-b7aa-44db3a448809 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:58.814688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7605c465-336c-4b9a-b7aa-44db3a448809 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:58.821138 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7605c465-336c-4b9a-b7aa-44db3a448809 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:58.821744 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7605c465-336c-4b9a-b7aa-44db3a448809 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:58.823455 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7605c465-336c-4b9a-b7aa-44db3a448809 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:58.823900 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7605c465-336c-4b9a-b7aa-44db3a448809 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:58.897497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7605c465-336c-4b9a-b7aa-44db3a448809 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:58.906197 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7605c465-336c-4b9a-b7aa-44db3a448809 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1266 microversion: 2.1 time: 0.097732 Jul 26 17:14:58.906790 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 128/247] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:58 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:14:59.565590 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d224d49a-3501-4859-a9a6-358809fef978 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:59.566448 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d224d49a-3501-4859-a9a6-358809fef978 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:59.577908 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d224d49a-3501-4859-a9a6-358809fef978 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:59.579050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d224d49a-3501-4859-a9a6-358809fef978 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:59.580537 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d224d49a-3501-4859-a9a6-358809fef978 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:59.581193 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d224d49a-3501-4859-a9a6-358809fef978 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:59.931349 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c7369a95-e4a5-4e1e-9ee9-12a54a297675 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:14:59.933220 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c7369a95-e4a5-4e1e-9ee9-12a54a297675 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:14:59.936994 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d224d49a-3501-4859-a9a6-358809fef978 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:14:59.945258 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7369a95-e4a5-4e1e-9ee9-12a54a297675 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:59.946100 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7369a95-e4a5-4e1e-9ee9-12a54a297675 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:14:59.946736 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d224d49a-3501-4859-a9a6-358809fef978 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.387145 Jul 26 17:14:59.947347 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 120/248] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:59 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:14:59.948124 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7369a95-e4a5-4e1e-9ee9-12a54a297675 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:14:59.949613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7369a95-e4a5-4e1e-9ee9-12a54a297675 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:00.156055 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c7369a95-e4a5-4e1e-9ee9-12a54a297675 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:00.167683 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c7369a95-e4a5-4e1e-9ee9-12a54a297675 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1272 microversion: 2.1 time: 0.243222 Jul 26 17:15:00.169066 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 129/249] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:14:59 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1272 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:00.975351 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-16ee8c2a-e786-45db-9d3d-1174020d959c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:00.976481 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-16ee8c2a-e786-45db-9d3d-1174020d959c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:00.989580 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-16ee8c2a-e786-45db-9d3d-1174020d959c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:00.990794 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-16ee8c2a-e786-45db-9d3d-1174020d959c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:00.992459 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-16ee8c2a-e786-45db-9d3d-1174020d959c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:00.993293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-16ee8c2a-e786-45db-9d3d-1174020d959c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:01.196771 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-091caf85-41df-4110-a8b9-76c65d800d69 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:01.198807 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-091caf85-41df-4110-a8b9-76c65d800d69 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:01.211138 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-091caf85-41df-4110-a8b9-76c65d800d69 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:01.212387 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-091caf85-41df-4110-a8b9-76c65d800d69 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:01.214223 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-091caf85-41df-4110-a8b9-76c65d800d69 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:01.214964 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-091caf85-41df-4110-a8b9-76c65d800d69 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:01.385529 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-16ee8c2a-e786-45db-9d3d-1174020d959c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:01.389416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=100 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:01.409158 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-16ee8c2a-e786-45db-9d3d-1174020d959c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.440521 Jul 26 17:15:01.410647 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 121/250] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:00 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:01.452754 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-091caf85-41df-4110-a8b9-76c65d800d69 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:01.467849 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-091caf85-41df-4110-a8b9-76c65d800d69 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1314 microversion: 2.1 time: 0.278084 Jul 26 17:15:01.469529 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 130/251] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:01 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:01.925419 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-dcd8efe1-adcd-490c-8793-ac1e17d5fb39 req-632e122d-586c-40d6-92ac-53c0dc017779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4319adf0-b460-4b5f-9697-5a649f803c84", "tag": "8a2cc7a0-7f3e-4ca3-9720-d02379858388"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:01.945622 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-dcd8efe1-adcd-490c-8793-ac1e17d5fb39 req-632e122d-586c-40d6-92ac-53c0dc017779 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:01.945622 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-dcd8efe1-adcd-490c-8793-ac1e17d5fb39 req-632e122d-586c-40d6-92ac-53c0dc017779 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:01.959075 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-dcd8efe1-adcd-490c-8793-ac1e17d5fb39 req-632e122d-586c-40d6-92ac-53c0dc017779 service nova] Creating event network-changed:8a2cc7a0-7f3e-4ca3-9720-d02379858388 for instance 4319adf0-b460-4b5f-9697-5a649f803c84 on hv-cinder-83538 Jul 26 17:15:01.966160 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-dcd8efe1-adcd-490c-8793-ac1e17d5fb39 req-632e122d-586c-40d6-92ac-53c0dc017779 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058757 Jul 26 17:15:01.969183 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 122/252] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:15:02.434593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a2e1aad8-bee6-4138-be26-916b0440630e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:02.436128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a2e1aad8-bee6-4138-be26-916b0440630e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:02.446720 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a2e1aad8-bee6-4138-be26-916b0440630e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:02.447370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a2e1aad8-bee6-4138-be26-916b0440630e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:02.448513 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a2e1aad8-bee6-4138-be26-916b0440630e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:02.449184 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a2e1aad8-bee6-4138-be26-916b0440630e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:02.499637 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d592f31a-bdcb-4328-80b2-91916fa95f1b tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:02.501141 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d592f31a-bdcb-4328-80b2-91916fa95f1b tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:02.509889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d592f31a-bdcb-4328-80b2-91916fa95f1b tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:02.510485 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d592f31a-bdcb-4328-80b2-91916fa95f1b tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:02.511653 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d592f31a-bdcb-4328-80b2-91916fa95f1b tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:02.512571 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d592f31a-bdcb-4328-80b2-91916fa95f1b tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:02.695980 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a2e1aad8-bee6-4138-be26-916b0440630e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:02.708941 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a2e1aad8-bee6-4138-be26-916b0440630e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.279539 Jul 26 17:15:02.709988 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 131/253] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:02 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:02.731416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d592f31a-bdcb-4328-80b2-91916fa95f1b tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:02.740088 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d592f31a-bdcb-4328-80b2-91916fa95f1b tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1314 microversion: 2.1 time: 0.247392 Jul 26 17:15:02.740699 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 123/254] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:02 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:03.737331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4ff5ec90-a400-4ada-89d1-3d6e801405d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:03.738795 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4ff5ec90-a400-4ada-89d1-3d6e801405d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:03.749314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ff5ec90-a400-4ada-89d1-3d6e801405d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:03.749771 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ff5ec90-a400-4ada-89d1-3d6e801405d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:03.750558 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ff5ec90-a400-4ada-89d1-3d6e801405d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:03.751159 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ff5ec90-a400-4ada-89d1-3d6e801405d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:03.765322 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-da977179-c3f2-41bd-a780-83c37f3dc7c9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:03.766791 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-da977179-c3f2-41bd-a780-83c37f3dc7c9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:03.784999 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-da977179-c3f2-41bd-a780-83c37f3dc7c9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:03.785994 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-da977179-c3f2-41bd-a780-83c37f3dc7c9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:03.786976 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-da977179-c3f2-41bd-a780-83c37f3dc7c9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:03.787633 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-da977179-c3f2-41bd-a780-83c37f3dc7c9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:04.010682 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4ff5ec90-a400-4ada-89d1-3d6e801405d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:04.026349 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4ff5ec90-a400-4ada-89d1-3d6e801405d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.295418 Jul 26 17:15:04.038972 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 132/255] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:03 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:04.110394 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-da977179-c3f2-41bd-a780-83c37f3dc7c9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:04.127529 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-da977179-c3f2-41bd-a780-83c37f3dc7c9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1314 microversion: 2.1 time: 0.367462 Jul 26 17:15:04.129719 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 124/256] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:03 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:05.059145 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-900ca7b1-e1a2-4cdb-ab2e-9c1f9b7da493 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:05.059811 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-900ca7b1-e1a2-4cdb-ab2e-9c1f9b7da493 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:05.066596 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-900ca7b1-e1a2-4cdb-ab2e-9c1f9b7da493 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:05.067051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-900ca7b1-e1a2-4cdb-ab2e-9c1f9b7da493 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:05.067841 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-900ca7b1-e1a2-4cdb-ab2e-9c1f9b7da493 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:05.068305 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-900ca7b1-e1a2-4cdb-ab2e-9c1f9b7da493 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:05.151644 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9c981552-e6ad-43a4-9dd5-d9a7add879dd tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:05.152998 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9c981552-e6ad-43a4-9dd5-d9a7add879dd tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:05.160722 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9c981552-e6ad-43a4-9dd5-d9a7add879dd tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:05.161310 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9c981552-e6ad-43a4-9dd5-d9a7add879dd tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:05.162235 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9c981552-e6ad-43a4-9dd5-d9a7add879dd tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:05.162916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9c981552-e6ad-43a4-9dd5-d9a7add879dd tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:05.268202 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-900ca7b1-e1a2-4cdb-ab2e-9c1f9b7da493 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:05.277368 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-900ca7b1-e1a2-4cdb-ab2e-9c1f9b7da493 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.221956 Jul 26 17:15:05.278424 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 133/257] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:05 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:05.347598 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9c981552-e6ad-43a4-9dd5-d9a7add879dd tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:05.360791 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9c981552-e6ad-43a4-9dd5-d9a7add879dd tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1314 microversion: 2.1 time: 0.213028 Jul 26 17:15:05.361407 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 125/258] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:05 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:05.772243 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-922c057d-7b2f-4896-9e49-652d01c5794b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:05.773127 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-922c057d-7b2f-4896-9e49-652d01c5794b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:05.781244 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-922c057d-7b2f-4896-9e49-652d01c5794b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:05.781748 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-922c057d-7b2f-4896-9e49-652d01c5794b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:05.782625 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-922c057d-7b2f-4896-9e49-652d01c5794b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:05.783092 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-922c057d-7b2f-4896-9e49-652d01c5794b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:05.785477 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-482120147", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "networks": [{"uuid": "23192039-2da3-4605-a273-90ee307665e7"}]}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:05.807774 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-922c057d-7b2f-4896-9e49-652d01c5794b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/ips" status: 200 len: 152 microversion: 2.20 time: 0.044590 Jul 26 17:15:05.809176 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 134/259] 10.222.0.48 () {60 vars in 1289 bytes} [Tue Jul 26 17:15:05 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:15:05.848857 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.network.neutron [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] validate_networks() for [('23192039-2da3-4605-a273-90ee307665e7', None, None, None, None, None)] {{(pid=118122) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:15:06.302431 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a0ccbe4f-bb0e-4f71-8c11-75df968edd28 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:06.304179 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a0ccbe4f-bb0e-4f71-8c11-75df968edd28 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:06.314836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0ccbe4f-bb0e-4f71-8c11-75df968edd28 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:06.315789 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0ccbe4f-bb0e-4f71-8c11-75df968edd28 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:06.317335 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0ccbe4f-bb0e-4f71-8c11-75df968edd28 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:06.318625 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0ccbe4f-bb0e-4f71-8c11-75df968edd28 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:06.380119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Flavor limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:15:06.380555 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Image limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:15:06.381063 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Flavor pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:15:06.381747 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Image pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:15:06.382171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:15:06.396524 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:06.407568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:06.409877 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:06.410391 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:06.440392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Getting quotas for project d379bf9c35444978b63c8a5a1e337928. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:15:06.447679 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Getting quotas for user 9d951f022d244c348e045966c33d5663 and project d379bf9c35444978b63c8a5a1e337928. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:15:06.464186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Going to run 1 instances... {{(pid=118122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:15:06.469847 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:15:06.543151 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d3a7e400-56db-499d-afba-ccef9819fd26 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761988 Jul 26 17:15:06.550697 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 126/260] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:15:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:15:06.550697 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5f52019a-b23d-4a90-98c2-5c1ce5158d31 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:06.550697 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5f52019a-b23d-4a90-98c2-5c1ce5158d31 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:06.561903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5f52019a-b23d-4a90-98c2-5c1ce5158d31 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:06.563111 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5f52019a-b23d-4a90-98c2-5c1ce5158d31 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:06.566483 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5f52019a-b23d-4a90-98c2-5c1ce5158d31 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:06.567176 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5f52019a-b23d-4a90-98c2-5c1ce5158d31 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:06.611224 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0ccbe4f-bb0e-4f71-8c11-75df968edd28 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:06.619924 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a0ccbe4f-bb0e-4f71-8c11-75df968edd28 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.323160 Jul 26 17:15:06.620773 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 135/261] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:06 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:06.626856 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-5ee1735a-a417-4b60-b667-f5b2cd011b50 req-303ee09f-e5bd-4690-a91b-9ee913e37876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4319adf0-b460-4b5f-9697-5a649f803c84", "name": "network-vif-plugged", "status": "completed", "tag": "8a2cc7a0-7f3e-4ca3-9720-d02379858388"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:06.637100 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-5ee1735a-a417-4b60-b667-f5b2cd011b50 req-303ee09f-e5bd-4690-a91b-9ee913e37876 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:06.637642 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-5ee1735a-a417-4b60-b667-f5b2cd011b50 req-303ee09f-e5bd-4690-a91b-9ee913e37876 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:06.652862 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-5ee1735a-a417-4b60-b667-f5b2cd011b50 req-303ee09f-e5bd-4690-a91b-9ee913e37876 service nova] Creating event network-vif-plugged:8a2cc7a0-7f3e-4ca3-9720-d02379858388 for instance 4319adf0-b460-4b5f-9697-5a649f803c84 on hv-cinder-83538 Jul 26 17:15:06.659089 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-5ee1735a-a417-4b60-b667-f5b2cd011b50 req-303ee09f-e5bd-4690-a91b-9ee913e37876 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037127 Jul 26 17:15:06.664244 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 136/262] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:15:06.671591 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-68468c30-d539-4dc6-893d-df1dcac97043 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:06.672620 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-68468c30-d539-4dc6-893d-df1dcac97043 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:06.680728 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68468c30-d539-4dc6-893d-df1dcac97043 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:06.682018 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68468c30-d539-4dc6-893d-df1dcac97043 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:06.683280 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68468c30-d539-4dc6-893d-df1dcac97043 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:06.683883 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68468c30-d539-4dc6-893d-df1dcac97043 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:06.719744 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-68468c30-d539-4dc6-893d-df1dcac97043 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/ips" status: 200 len: 149 microversion: 2.1 time: 0.053970 Jul 26 17:15:06.720694 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 137/263] 10.222.0.48 () {58 vars in 1248 bytes} [Tue Jul 26 17:15:06 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:15:06.726829 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c86e5b6a-c4c0-41a5-aba5-796cbe322e90 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:06.727887 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c86e5b6a-c4c0-41a5-aba5-796cbe322e90 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:06.821123 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5f52019a-b23d-4a90-98c2-5c1ce5158d31 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:06.825273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c86e5b6a-c4c0-41a5-aba5-796cbe322e90 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:06.829817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5f52019a-b23d-4a90-98c2-5c1ce5158d31 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1314 microversion: 2.1 time: 0.283969 Jul 26 17:15:06.830405 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 127/264] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:06 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:06.834340 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c86e5b6a-c4c0-41a5-aba5-796cbe322e90 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1218 microversion: 2.1 time: 0.112404 Jul 26 17:15:06.835220 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 138/265] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:06 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:07.645666 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9f6b1ba5-8ea8-42e7-959d-cdd7edd898a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:07.646464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9f6b1ba5-8ea8-42e7-959d-cdd7edd898a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:07.648547 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:07.655256 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9f6b1ba5-8ea8-42e7-959d-cdd7edd898a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:07.655742 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9f6b1ba5-8ea8-42e7-959d-cdd7edd898a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:07.656598 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9f6b1ba5-8ea8-42e7-959d-cdd7edd898a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:07.657222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9f6b1ba5-8ea8-42e7-959d-cdd7edd898a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:07.817730 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9f6b1ba5-8ea8-42e7-959d-cdd7edd898a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:07.830957 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9f6b1ba5-8ea8-42e7-959d-cdd7edd898a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.192505 Jul 26 17:15:07.831989 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 128/266] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:07 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:07.855554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0e5210f2-a4a6-4457-9708-47d31c5b4ff9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:07.856530 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0e5210f2-a4a6-4457-9708-47d31c5b4ff9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:07.865960 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e5210f2-a4a6-4457-9708-47d31c5b4ff9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:07.866241 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e5210f2-a4a6-4457-9708-47d31c5b4ff9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:07.867269 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e5210f2-a4a6-4457-9708-47d31c5b4ff9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:07.867933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e5210f2-a4a6-4457-9708-47d31c5b4ff9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:07.868415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-480cff31-93fc-4690-80a0-c799c2450474 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:07.869293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-480cff31-93fc-4690-80a0-c799c2450474 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:07.879024 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-480cff31-93fc-4690-80a0-c799c2450474 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:07.879872 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-480cff31-93fc-4690-80a0-c799c2450474 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:07.881199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-480cff31-93fc-4690-80a0-c799c2450474 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:07.882225 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-480cff31-93fc-4690-80a0-c799c2450474 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:07.968063 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-480cff31-93fc-4690-80a0-c799c2450474 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:07.979386 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-480cff31-93fc-4690-80a0-c799c2450474 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1214 microversion: 2.1 time: 0.116472 Jul 26 17:15:07.993773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 129/267] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:07 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:08.108654 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0e5210f2-a4a6-4457-9708-47d31c5b4ff9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:08.131772 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0e5210f2-a4a6-4457-9708-47d31c5b4ff9 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1314 microversion: 2.1 time: 0.281798 Jul 26 17:15:08.133047 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 139/268] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:07 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:08.355417 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4f0a83e6-b764-481b-b840-27944593e7f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae9589ee-c4be-487e-bb4c-65101ac5d0b3"}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:08.359885 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4f0a83e6-b764-481b-b840-27944593e7f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:08.369577 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f0a83e6-b764-481b-b840-27944593e7f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:08.370402 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f0a83e6-b764-481b-b840-27944593e7f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:08.371683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f0a83e6-b764-481b-b840-27944593e7f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:08.372648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f0a83e6-b764-481b-b840-27944593e7f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:08.859930 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9f8f8e94-b7d3-4250-9cc3-d612ba8f3a98 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:08.860999 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9f8f8e94-b7d3-4250-9cc3-d612ba8f3a98 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:08.865032 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:08.875494 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f8f8e94-b7d3-4250-9cc3-d612ba8f3a98 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:08.875494 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f8f8e94-b7d3-4250-9cc3-d612ba8f3a98 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:08.875494 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f8f8e94-b7d3-4250-9cc3-d612ba8f3a98 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:08.875789 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f8f8e94-b7d3-4250-9cc3-d612ba8f3a98 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:09.080013 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9f8f8e94-b7d3-4250-9cc3-d612ba8f3a98 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:09.093442 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9f8f8e94-b7d3-4250-9cc3-d612ba8f3a98 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.240321 Jul 26 17:15:09.094443 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 140/269] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:08 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:09.103117 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3af791e6-123e-4bd5-bf3f-27534761dd13 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:09.104261 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3af791e6-123e-4bd5-bf3f-27534761dd13 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:09.116569 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3af791e6-123e-4bd5-bf3f-27534761dd13 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:09.117304 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3af791e6-123e-4bd5-bf3f-27534761dd13 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:09.119036 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3af791e6-123e-4bd5-bf3f-27534761dd13 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:09.120174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3af791e6-123e-4bd5-bf3f-27534761dd13 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:09.212941 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3af791e6-123e-4bd5-bf3f-27534761dd13 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:09.227058 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3af791e6-123e-4bd5-bf3f-27534761dd13 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1270 microversion: 2.1 time: 0.130935 Jul 26 17:15:09.227896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 141/270] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:09 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:09.235410 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7fed540c-6b33-47fb-828f-605f13c13d1f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:09.236188 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7fed540c-6b33-47fb-828f-605f13c13d1f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:09.245044 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fed540c-6b33-47fb-828f-605f13c13d1f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:09.245426 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fed540c-6b33-47fb-828f-605f13c13d1f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:09.246408 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fed540c-6b33-47fb-828f-605f13c13d1f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:09.247051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fed540c-6b33-47fb-828f-605f13c13d1f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:09.274299 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-7fed540c-6b33-47fb-828f-605f13c13d1f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lazy-loading 'flavor' on Instance uuid 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:15:09.325084 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:09.490891 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7fed540c-6b33-47fb-828f-605f13c13d1f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "POST /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/action" status: 202 len: 0 microversion: 2.20 time: 0.261558 Jul 26 17:15:09.491662 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 142/271] 10.222.0.48 () {62 vars in 1319 bytes} [Tue Jul 26 17:15:09 2022] POST /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:15:09.501164 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d5b3095d-ad9c-4804-a4aa-b931e49b1ffb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:09.501871 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d5b3095d-ad9c-4804-a4aa-b931e49b1ffb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:09.514437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d5b3095d-ad9c-4804-a4aa-b931e49b1ffb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:09.514437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d5b3095d-ad9c-4804-a4aa-b931e49b1ffb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:09.514437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d5b3095d-ad9c-4804-a4aa-b931e49b1ffb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:09.514437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d5b3095d-ad9c-4804-a4aa-b931e49b1ffb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:09.702721 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d5b3095d-ad9c-4804-a4aa-b931e49b1ffb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:09.711230 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d5b3095d-ad9c-4804-a4aa-b931e49b1ffb tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1497 microversion: 2.1 time: 0.216793 Jul 26 17:15:09.711817 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 143/272] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:09 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1497 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:09.716930 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6a6506b0-9688-47d3-a483-168288b91d31 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:09.717851 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6a6506b0-9688-47d3-a483-168288b91d31 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:09.724479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a6506b0-9688-47d3-a483-168288b91d31 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:09.724921 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a6506b0-9688-47d3-a483-168288b91d31 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:09.725741 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a6506b0-9688-47d3-a483-168288b91d31 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:09.726180 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a6506b0-9688-47d3-a483-168288b91d31 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:09.900216 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a6506b0-9688-47d3-a483-168288b91d31 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:09.912519 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a6506b0-9688-47d3-a483-168288b91d31 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:09.914469 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a6506b0-9688-47d3-a483-168288b91d31 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:09.915779 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6a6506b0-9688-47d3-a483-168288b91d31 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.202960 Jul 26 17:15:09.916648 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 144/273] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:09 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:10.134652 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-458539c7-6adb-42ea-b390-c5c6ff092a85 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:10.135562 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-458539c7-6adb-42ea-b390-c5c6ff092a85 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:10.154741 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-458539c7-6adb-42ea-b390-c5c6ff092a85 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:10.160331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-458539c7-6adb-42ea-b390-c5c6ff092a85 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:10.162837 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-458539c7-6adb-42ea-b390-c5c6ff092a85 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:10.165604 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-458539c7-6adb-42ea-b390-c5c6ff092a85 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:10.290365 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4f0a83e6-b764-481b-b840-27944593e7f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.942253 Jul 26 17:15:10.293488 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 130/274] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:15:08 2022] POST /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/os-volume_attachments => generated 194 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:15:10.308924 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-cf98e2ba-47cd-4716-a648-f33c22676449 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:10.310496 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-cf98e2ba-47cd-4716-a648-f33c22676449 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:10.319602 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cf98e2ba-47cd-4716-a648-f33c22676449 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:10.320434 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cf98e2ba-47cd-4716-a648-f33c22676449 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:10.321568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cf98e2ba-47cd-4716-a648-f33c22676449 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:10.322246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cf98e2ba-47cd-4716-a648-f33c22676449 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:10.441281 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-458539c7-6adb-42ea-b390-c5c6ff092a85 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:10.450177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-458539c7-6adb-42ea-b390-c5c6ff092a85 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.322979 Jul 26 17:15:10.453187 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 145/275] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:10 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:10.467138 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-cf98e2ba-47cd-4716-a648-f33c22676449 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:10.480117 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-cf98e2ba-47cd-4716-a648-f33c22676449 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1276 microversion: 2.1 time: 0.183512 Jul 26 17:15:10.481073 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 131/276] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:10 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:10.519917 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-758a7ac7-040d-4c9c-85dc-2569c3a8305d tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:10.520508 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-758a7ac7-040d-4c9c-85dc-2569c3a8305d tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:10.527078 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-758a7ac7-040d-4c9c-85dc-2569c3a8305d tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:10.527536 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-758a7ac7-040d-4c9c-85dc-2569c3a8305d tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:10.528305 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-758a7ac7-040d-4c9c-85dc-2569c3a8305d tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:10.529854 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-758a7ac7-040d-4c9c-85dc-2569c3a8305d tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:10.557163 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-758a7ac7-040d-4c9c-85dc-2569c3a8305d tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:15:10.662104 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-758a7ac7-040d-4c9c-85dc-2569c3a8305d tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 204 len: 0 microversion: 2.1 time: 0.145422 Jul 26 17:15:10.662609 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 146/277] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:15:10 2022] DELETE /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 17:15:10.674484 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e69ebda9-a329-407e-b05a-cd421765cf91 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:10.675097 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-e69ebda9-a329-407e-b05a-cd421765cf91 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:10.681998 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e69ebda9-a329-407e-b05a-cd421765cf91 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:10.682604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e69ebda9-a329-407e-b05a-cd421765cf91 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:10.683480 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e69ebda9-a329-407e-b05a-cd421765cf91 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:10.683915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e69ebda9-a329-407e-b05a-cd421765cf91 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:10.855328 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e69ebda9-a329-407e-b05a-cd421765cf91 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:10.868081 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e69ebda9-a329-407e-b05a-cd421765cf91 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1503 microversion: 2.1 time: 0.199468 Jul 26 17:15:10.868940 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 132/278] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:10 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:10.941057 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-680463c5-9e55-469e-83be-912876477ef5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:10.942088 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-680463c5-9e55-469e-83be-912876477ef5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:10.949757 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-680463c5-9e55-469e-83be-912876477ef5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:10.950213 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-680463c5-9e55-469e-83be-912876477ef5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:10.951119 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-680463c5-9e55-469e-83be-912876477ef5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:10.951861 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-680463c5-9e55-469e-83be-912876477ef5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:11.123308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-680463c5-9e55-469e-83be-912876477ef5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:11.131841 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-680463c5-9e55-469e-83be-912876477ef5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:11.133387 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-680463c5-9e55-469e-83be-912876477ef5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:11.134573 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-680463c5-9e55-469e-83be-912876477ef5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.198081 Jul 26 17:15:11.135220 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 147/279] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:10 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:11.475668 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d8375b5f-4018-4b81-ab72-73f4eb82c09c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:11.476412 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d8375b5f-4018-4b81-ab72-73f4eb82c09c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:11.485171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d8375b5f-4018-4b81-ab72-73f4eb82c09c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:11.485930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d8375b5f-4018-4b81-ab72-73f4eb82c09c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:11.487239 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d8375b5f-4018-4b81-ab72-73f4eb82c09c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:11.487898 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d8375b5f-4018-4b81-ab72-73f4eb82c09c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:11.517696 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4b25cd27-cdbe-4129-bf15-271f70609b56 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:11.518813 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4b25cd27-cdbe-4129-bf15-271f70609b56 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:11.530630 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b25cd27-cdbe-4129-bf15-271f70609b56 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:11.531405 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b25cd27-cdbe-4129-bf15-271f70609b56 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:11.532761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b25cd27-cdbe-4129-bf15-271f70609b56 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:11.533581 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b25cd27-cdbe-4129-bf15-271f70609b56 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:11.647691 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4b25cd27-cdbe-4129-bf15-271f70609b56 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:11.656494 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4b25cd27-cdbe-4129-bf15-271f70609b56 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1276 microversion: 2.1 time: 0.146738 Jul 26 17:15:11.657412 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 148/280] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:11 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:11.731454 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d8375b5f-4018-4b81-ab72-73f4eb82c09c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:11.740729 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d8375b5f-4018-4b81-ab72-73f4eb82c09c tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.268799 Jul 26 17:15:11.741588 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 133/281] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:11 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:11.907329 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f3c01584-c7d0-472b-8438-61ea422e0b14 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:11.908200 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f3c01584-c7d0-472b-8438-61ea422e0b14 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:11.915713 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3c01584-c7d0-472b-8438-61ea422e0b14 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:11.918886 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3c01584-c7d0-472b-8438-61ea422e0b14 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:11.918886 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3c01584-c7d0-472b-8438-61ea422e0b14 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:11.918886 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3c01584-c7d0-472b-8438-61ea422e0b14 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:12.100832 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f3c01584-c7d0-472b-8438-61ea422e0b14 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:12.109518 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f3c01584-c7d0-472b-8438-61ea422e0b14 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1503 microversion: 2.1 time: 0.207315 Jul 26 17:15:12.110111 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 149/282] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:11 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:12.159440 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-dc1652cd-8860-445e-b9d9-9bd4901569e1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:12.160170 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-dc1652cd-8860-445e-b9d9-9bd4901569e1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:12.169950 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dc1652cd-8860-445e-b9d9-9bd4901569e1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:12.170636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dc1652cd-8860-445e-b9d9-9bd4901569e1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:12.171955 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dc1652cd-8860-445e-b9d9-9bd4901569e1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:12.172735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dc1652cd-8860-445e-b9d9-9bd4901569e1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:12.348677 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-dc1652cd-8860-445e-b9d9-9bd4901569e1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:12.359229 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-dc1652cd-8860-445e-b9d9-9bd4901569e1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:12.360744 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-dc1652cd-8860-445e-b9d9-9bd4901569e1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:12.361967 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-dc1652cd-8860-445e-b9d9-9bd4901569e1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.207121 Jul 26 17:15:12.362539 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 134/283] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:12 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:12.686547 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b78240ad-5860-4ca2-86bc-5e8530d62d09 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:12.687127 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b78240ad-5860-4ca2-86bc-5e8530d62d09 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:12.693857 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b78240ad-5860-4ca2-86bc-5e8530d62d09 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:12.694310 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b78240ad-5860-4ca2-86bc-5e8530d62d09 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:12.695090 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b78240ad-5860-4ca2-86bc-5e8530d62d09 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:12.695524 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b78240ad-5860-4ca2-86bc-5e8530d62d09 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:12.764854 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a6a24cab-aaf8-439e-b10e-141e6dbad951 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:12.765895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a6a24cab-aaf8-439e-b10e-141e6dbad951 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:12.774470 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a6a24cab-aaf8-439e-b10e-141e6dbad951 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:12.775266 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a6a24cab-aaf8-439e-b10e-141e6dbad951 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:12.776649 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a6a24cab-aaf8-439e-b10e-141e6dbad951 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:12.777296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a6a24cab-aaf8-439e-b10e-141e6dbad951 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:12.866414 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b78240ad-5860-4ca2-86bc-5e8530d62d09 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:12.875460 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b78240ad-5860-4ca2-86bc-5e8530d62d09 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1318 microversion: 2.1 time: 0.193163 Jul 26 17:15:12.876651 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 150/284] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:12 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:12.936636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a6a24cab-aaf8-439e-b10e-141e6dbad951 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:12.945014 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a6a24cab-aaf8-439e-b10e-141e6dbad951 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.184747 Jul 26 17:15:12.945607 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 135/285] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:12 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:13.137956 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ffb2109c-371b-4115-b957-7dcc2b688168 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:13.139924 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ffb2109c-371b-4115-b957-7dcc2b688168 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:13.152555 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ffb2109c-371b-4115-b957-7dcc2b688168 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:13.154674 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ffb2109c-371b-4115-b957-7dcc2b688168 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:13.156141 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ffb2109c-371b-4115-b957-7dcc2b688168 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:13.157186 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ffb2109c-371b-4115-b957-7dcc2b688168 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:13.390620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a22082bb-e391-4ee2-b3cc-98b3f3decd7b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:13.391829 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a22082bb-e391-4ee2-b3cc-98b3f3decd7b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:13.412947 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a22082bb-e391-4ee2-b3cc-98b3f3decd7b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:13.418436 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a22082bb-e391-4ee2-b3cc-98b3f3decd7b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:13.418436 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a22082bb-e391-4ee2-b3cc-98b3f3decd7b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:13.418836 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a22082bb-e391-4ee2-b3cc-98b3f3decd7b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:13.479155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ffb2109c-371b-4115-b957-7dcc2b688168 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:13.493877 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ffb2109c-371b-4115-b957-7dcc2b688168 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1503 microversion: 2.1 time: 0.363507 Jul 26 17:15:13.494879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 151/286] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:13 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1503 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:13.706621 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a22082bb-e391-4ee2-b3cc-98b3f3decd7b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:13.716033 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a22082bb-e391-4ee2-b3cc-98b3f3decd7b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:13.718920 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a22082bb-e391-4ee2-b3cc-98b3f3decd7b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:13.721039 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a22082bb-e391-4ee2-b3cc-98b3f3decd7b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.336415 Jul 26 17:15:13.733169 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 136/287] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:13 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:13.899896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6c21e4bd-4502-439a-9bc7-48d1183f5336 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:13.900635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6c21e4bd-4502-439a-9bc7-48d1183f5336 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:13.908754 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c21e4bd-4502-439a-9bc7-48d1183f5336 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:13.909282 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c21e4bd-4502-439a-9bc7-48d1183f5336 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:13.910095 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c21e4bd-4502-439a-9bc7-48d1183f5336 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:13.910527 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c21e4bd-4502-439a-9bc7-48d1183f5336 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:13.971592 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0c1c6b7d-a363-4baf-8890-8d90f7ef3a9d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:13.972345 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0c1c6b7d-a363-4baf-8890-8d90f7ef3a9d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:13.979706 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0c1c6b7d-a363-4baf-8890-8d90f7ef3a9d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:13.980237 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0c1c6b7d-a363-4baf-8890-8d90f7ef3a9d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:13.981130 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0c1c6b7d-a363-4baf-8890-8d90f7ef3a9d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:13.981838 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0c1c6b7d-a363-4baf-8890-8d90f7ef3a9d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:14.198112 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6c21e4bd-4502-439a-9bc7-48d1183f5336 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:14.211499 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6c21e4bd-4502-439a-9bc7-48d1183f5336 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1318 microversion: 2.1 time: 0.317349 Jul 26 17:15:14.212896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 152/288] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:13 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:14.234239 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-05724643-0224-4bb8-bc6e-658f2c757d66 req-f0dfab37-0247-42eb-b0f2-6f60c007bd9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4c1664-d4a2-4f59-8f45-2025f237a3cc", "tag": "bfe45947-fc60-41ad-a94c-7cdebb82c3a9"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:14.253815 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-05724643-0224-4bb8-bc6e-658f2c757d66 req-f0dfab37-0247-42eb-b0f2-6f60c007bd9d service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:14.254695 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-05724643-0224-4bb8-bc6e-658f2c757d66 req-f0dfab37-0247-42eb-b0f2-6f60c007bd9d service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:14.268653 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-05724643-0224-4bb8-bc6e-658f2c757d66 req-f0dfab37-0247-42eb-b0f2-6f60c007bd9d service nova] Creating event network-changed:bfe45947-fc60-41ad-a94c-7cdebb82c3a9 for instance af4c1664-d4a2-4f59-8f45-2025f237a3cc on hv-cinder-83538 Jul 26 17:15:14.274464 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-05724643-0224-4bb8-bc6e-658f2c757d66 req-f0dfab37-0247-42eb-b0f2-6f60c007bd9d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051266 Jul 26 17:15:14.275068 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 153/289] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:15:14.307418 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0c1c6b7d-a363-4baf-8890-8d90f7ef3a9d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:14.316755 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0c1c6b7d-a363-4baf-8890-8d90f7ef3a9d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.354676 Jul 26 17:15:14.317481 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 137/290] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:13 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:14.435256 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-8120ef5d-611d-4c84-b26d-e217c08e1133 req-238746b6-8711-4c8a-b732-65de29ac5685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4319adf0-b460-4b5f-9697-5a649f803c84", "name": "network-vif-deleted", "tag": "8a2cc7a0-7f3e-4ca3-9720-d02379858388"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:14.446199 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-8120ef5d-611d-4c84-b26d-e217c08e1133 req-238746b6-8711-4c8a-b732-65de29ac5685 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:14.446661 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-8120ef5d-611d-4c84-b26d-e217c08e1133 req-238746b6-8711-4c8a-b732-65de29ac5685 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:14.460878 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-8120ef5d-611d-4c84-b26d-e217c08e1133 req-238746b6-8711-4c8a-b732-65de29ac5685 service nova] Creating event network-vif-deleted:8a2cc7a0-7f3e-4ca3-9720-d02379858388 for instance 4319adf0-b460-4b5f-9697-5a649f803c84 on hv-cinder-83538 Jul 26 17:15:14.467172 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-8120ef5d-611d-4c84-b26d-e217c08e1133 req-238746b6-8711-4c8a-b732-65de29ac5685 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035486 Jul 26 17:15:14.468003 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 154/291] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:15:14.531957 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-046bf713-afb2-44b4-86c7-1317506c83d7 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:14.532817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-046bf713-afb2-44b4-86c7-1317506c83d7 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:14.539916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-046bf713-afb2-44b4-86c7-1317506c83d7 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:14.541107 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-046bf713-afb2-44b4-86c7-1317506c83d7 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:14.541938 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-046bf713-afb2-44b4-86c7-1317506c83d7 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:14.542385 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-046bf713-afb2-44b4-86c7-1317506c83d7 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:14.560564 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:14.627329 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-046bf713-afb2-44b4-86c7-1317506c83d7 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:14.633058 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-046bf713-afb2-44b4-86c7-1317506c83d7 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1299 microversion: 2.1 time: 0.107152 Jul 26 17:15:14.633727 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 138/292] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:14 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:14.746461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-30e16d8c-2803-4a81-ae7d-4bcad5031fbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:14.747164 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-30e16d8c-2803-4a81-ae7d-4bcad5031fbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:14.755587 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30e16d8c-2803-4a81-ae7d-4bcad5031fbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:14.756326 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30e16d8c-2803-4a81-ae7d-4bcad5031fbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:14.757304 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30e16d8c-2803-4a81-ae7d-4bcad5031fbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:14.757922 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30e16d8c-2803-4a81-ae7d-4bcad5031fbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:14.985251 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-30e16d8c-2803-4a81-ae7d-4bcad5031fbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:14.993896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-30e16d8c-2803-4a81-ae7d-4bcad5031fbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:14.995435 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-30e16d8c-2803-4a81-ae7d-4bcad5031fbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:14.996879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-30e16d8c-2803-4a81-ae7d-4bcad5031fbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.255306 Jul 26 17:15:14.998080 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 155/293] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:14 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:15.236403 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-90bffa3e-7a1a-4791-b193-64f8d8a03108 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:15.237473 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-90bffa3e-7a1a-4791-b193-64f8d8a03108 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:15.244184 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-90bffa3e-7a1a-4791-b193-64f8d8a03108 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.244551 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-90bffa3e-7a1a-4791-b193-64f8d8a03108 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:15.245358 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-90bffa3e-7a1a-4791-b193-64f8d8a03108 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.246052 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-90bffa3e-7a1a-4791-b193-64f8d8a03108 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:15.343990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cd7b9b3b-fa24-4ac4-9efe-3e0416b6ad43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:15.345645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cd7b9b3b-fa24-4ac4-9efe-3e0416b6ad43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:15.362996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd7b9b3b-fa24-4ac4-9efe-3e0416b6ad43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.363581 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd7b9b3b-fa24-4ac4-9efe-3e0416b6ad43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:15.364616 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd7b9b3b-fa24-4ac4-9efe-3e0416b6ad43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.366103 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd7b9b3b-fa24-4ac4-9efe-3e0416b6ad43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:15.412242 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-90bffa3e-7a1a-4791-b193-64f8d8a03108 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:15.427186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-90bffa3e-7a1a-4791-b193-64f8d8a03108 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1318 microversion: 2.1 time: 0.194706 Jul 26 17:15:15.428239 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 139/294] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:15 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:15.655838 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-047dce0d-d4a8-4ba2-994d-ea59c5daa058 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:15.656619 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-047dce0d-d4a8-4ba2-994d-ea59c5daa058 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:15.663461 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-047dce0d-d4a8-4ba2-994d-ea59c5daa058 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.663907 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-047dce0d-d4a8-4ba2-994d-ea59c5daa058 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:15.664692 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-047dce0d-d4a8-4ba2-994d-ea59c5daa058 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.665177 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-047dce0d-d4a8-4ba2-994d-ea59c5daa058 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:15.699255 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-047dce0d-d4a8-4ba2-994d-ea59c5daa058 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.699712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-047dce0d-d4a8-4ba2-994d-ea59c5daa058 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:15.700161 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.objects.instance [None req-047dce0d-d4a8-4ba2-994d-ea59c5daa058 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lazy-loading 'fault' on Instance uuid 4319adf0-b460-4b5f-9697-5a649f803c84 {{(pid=118122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:15:15.708004 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cd7b9b3b-fa24-4ac4-9efe-3e0416b6ad43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:15.722056 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cd7b9b3b-fa24-4ac4-9efe-3e0416b6ad43 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1501 microversion: 2.1 time: 0.384543 Jul 26 17:15:15.722730 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 156/295] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:15 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1501 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:15.744254 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8c2e3007-e08b-49fb-9c3b-de08a1fcccac tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1f41b09-b5f4-49c7-af72-ceae2b5b9e08"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:15.748070 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8c2e3007-e08b-49fb-9c3b-de08a1fcccac tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:15.749051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-047dce0d-d4a8-4ba2-994d-ea59c5daa058 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:15.755672 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c2e3007-e08b-49fb-9c3b-de08a1fcccac tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.756215 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c2e3007-e08b-49fb-9c3b-de08a1fcccac tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:15.756862 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-047dce0d-d4a8-4ba2-994d-ea59c5daa058 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1304 microversion: 2.1 time: 0.105645 Jul 26 17:15:15.757227 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c2e3007-e08b-49fb-9c3b-de08a1fcccac tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.757570 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 140/296] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:15 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:15.757910 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c2e3007-e08b-49fb-9c3b-de08a1fcccac tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:15.783352 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-8c2e3007-e08b-49fb-9c3b-de08a1fcccac tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] HTTP exception thrown: Cannot 'attach_volume' instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 while it is in vm_state rescued Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8c2e3007-e08b-49fb-9c3b-de08a1fcccac tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Request method failure captured: Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: POST /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1/os-volume_attachments HTTP/1.1 Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 74 Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CC2x0eKkH9UXJgkwe-DjkCoDqloc4SydbPTIUNwkQQ0_-ouZD4LJcioqLwoynbj5fwOQ8ZgXQWu3c-hjOZFFvdgy6I-P1cEeLqhJgW3KkQqc5QCS1kbQ00kpGZ1KpgwuursPfQkB8oQIc4wtw4pQzOfyKY8lCWGfdT8KOsp-1vwtAw Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 2b8b6c88af94417c840fdafd1fe431b7 Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:15:15.785097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:15:15.786915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:15:15.786915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:15:15.786915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 2b8b6c88af94417c840fdafd1fe431b7 Jul 26 17:15:15.786915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:15:15.786915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-ServerRescueNegativeTestJSON-894760419-project Jul 26 17:15:15.786915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:15:15.786915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:15:15.786915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: 97115d07acc5464bb7b097039471fee6 Jul 26 17:15:15.786915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894760419-project Jul 26 17:15:15.786915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Jul 26 17:15:15.786915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {"volumeAttachment": {"volumeId": "a1f41b09-b5f4-49c7-af72-ceae2b5b9e08"}} Jul 26 17:15:15.786915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Cannot 'attach_volume' instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 while it is in vm_state rescued Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'server_id': '9254cf15-b0da-432c-81a4-a9b981a7eda1', 'body': {'volumeAttachment': {'volumeId': 'a1f41b09-b5f4-49c7-af72-ceae2b5b9e08'}}} Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:15:15.787954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 while it is in vm_state rescued Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:15:15.789270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:15:15.790639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:15:15.790639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:15:15.790639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 while it is in vm_state rescued Jul 26 17:15:15.790639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:15:15.790639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8c2e3007-e08b-49fb-9c3b-de08a1fcccac tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Returning 409 to user: Cannot 'attach_volume' instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 while it is in vm_state rescued {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:15:15.790639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8c2e3007-e08b-49fb-9c3b-de08a1fcccac tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "POST /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047082 Jul 26 17:15:15.790639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 157/297] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:15:15 2022] POST /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 17:15:15.799288 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ba8518af-19a6-4ec7-a468-5cf8285b3767 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:15.799822 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ba8518af-19a6-4ec7-a468-5cf8285b3767 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:15.807320 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ba8518af-19a6-4ec7-a468-5cf8285b3767 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.807775 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ba8518af-19a6-4ec7-a468-5cf8285b3767 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:15.808799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ba8518af-19a6-4ec7-a468-5cf8285b3767 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.809084 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ba8518af-19a6-4ec7-a468-5cf8285b3767 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:15.893550 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ba8518af-19a6-4ec7-a468-5cf8285b3767 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "POST /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1/action" status: 202 len: 0 microversion: 2.1 time: 0.098832 Jul 26 17:15:15.897851 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 141/298] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:15:15 2022] POST /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:15:15.905213 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-836bc4d6-fcd6-48b6-a0a9-224d23ffd943 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:15.906098 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-836bc4d6-fcd6-48b6-a0a9-224d23ffd943 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:15.914195 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-836bc4d6-fcd6-48b6-a0a9-224d23ffd943 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.914982 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-836bc4d6-fcd6-48b6-a0a9-224d23ffd943 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:15.915776 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-836bc4d6-fcd6-48b6-a0a9-224d23ffd943 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:15.916300 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-836bc4d6-fcd6-48b6-a0a9-224d23ffd943 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:16.034259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-10e907df-e2bc-4e94-adf5-97de663fe765 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:16.035562 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-10e907df-e2bc-4e94-adf5-97de663fe765 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:16.047802 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-10e907df-e2bc-4e94-adf5-97de663fe765 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:16.048638 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-10e907df-e2bc-4e94-adf5-97de663fe765 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:16.050422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-10e907df-e2bc-4e94-adf5-97de663fe765 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:16.051476 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-10e907df-e2bc-4e94-adf5-97de663fe765 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:16.074036 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-836bc4d6-fcd6-48b6-a0a9-224d23ffd943 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:16.081575 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:16.084468 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-836bc4d6-fcd6-48b6-a0a9-224d23ffd943 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1509 microversion: 2.1 time: 0.184805 Jul 26 17:15:16.085590 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 158/299] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:15 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:16.275290 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-10e907df-e2bc-4e94-adf5-97de663fe765 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:16.296327 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-10e907df-e2bc-4e94-adf5-97de663fe765 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:16.300367 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-10e907df-e2bc-4e94-adf5-97de663fe765 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:16.303113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-10e907df-e2bc-4e94-adf5-97de663fe765 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.277623 Jul 26 17:15:16.304247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 142/300] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:16 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:16.465351 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f1492140-6996-473c-af07-01fe1a2b5882 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:16.465959 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f1492140-6996-473c-af07-01fe1a2b5882 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:16.473888 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1492140-6996-473c-af07-01fe1a2b5882 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:16.474341 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1492140-6996-473c-af07-01fe1a2b5882 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:16.475124 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1492140-6996-473c-af07-01fe1a2b5882 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:16.475562 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1492140-6996-473c-af07-01fe1a2b5882 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:16.730896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f1492140-6996-473c-af07-01fe1a2b5882 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:16.748442 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f1492140-6996-473c-af07-01fe1a2b5882 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1318 microversion: 2.1 time: 0.287178 Jul 26 17:15:16.762549 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 159/301] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:16 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:16.780560 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f8372828-8166-4106-8e29-6c20e4335653 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:16.781241 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-f8372828-8166-4106-8e29-6c20e4335653 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:16.783697 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=4 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:16.794272 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=12 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:16.801604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f8372828-8166-4106-8e29-6c20e4335653 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:16.802414 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f8372828-8166-4106-8e29-6c20e4335653 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:16.803417 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f8372828-8166-4106-8e29-6c20e4335653 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:16.813756 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f8372828-8166-4106-8e29-6c20e4335653 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:16.861806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f8372828-8166-4106-8e29-6c20e4335653 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:16.862612 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f8372828-8166-4106-8e29-6c20e4335653 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:16.863359 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.objects.instance [None req-f8372828-8166-4106-8e29-6c20e4335653 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lazy-loading 'fault' on Instance uuid 4319adf0-b460-4b5f-9697-5a649f803c84 {{(pid=118122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:15:16.941590 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-f8372828-8166-4106-8e29-6c20e4335653 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ce2731e0c8647c2a7ea29a0569d2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396220daaf3f4a89aab4007f746b96ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:16.952316 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-f8372828-8166-4106-8e29-6c20e4335653 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 200 len: 1304 microversion: 2.1 time: 0.176913 Jul 26 17:15:16.963625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 143/302] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:16 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:17.113656 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8cf85b23-7933-4fa7-a348-44355860b96f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: .version_select at 0x7f6ca8c55670>, body: {"keypair": {"name": "tempest-keypair-630634567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3O4VgKcYTVzzFWkV1tarfC71J7e8LOsKfV+syRzPaun6/fyKmOf2Q3qfvxrd1lhZ0OOkeYr09lADEJIKyYBX2jcDMvFH6Gf2tP9+xU3J06Fnw0uJTyGfiPz1ZRK6XOEg=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:17.126531 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4eb68d3d-513f-4576-a364-0984655d27c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:17.127118 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=4 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:17.136080 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4eb68d3d-513f-4576-a364-0984655d27c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:17.139978 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-8cf85b23-7933-4fa7-a348-44355860b96f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:15:17.145255 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-8cf85b23-7933-4fa7-a348-44355860b96f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for user c6291932ceb84b03924c0f056f29c2a9 and project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:15:17.151455 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4eb68d3d-513f-4576-a364-0984655d27c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:17.152462 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4eb68d3d-513f-4576-a364-0984655d27c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:17.154791 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4eb68d3d-513f-4576-a364-0984655d27c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:17.155852 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4eb68d3d-513f-4576-a364-0984655d27c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:17.174594 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8cf85b23-7933-4fa7-a348-44355860b96f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067695 Jul 26 17:15:17.176274 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 160/303] 10.222.0.48 () {60 vars in 1159 bytes} [Tue Jul 26 17:15:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:15:17.343876 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3146650e-4707-48ac-b011-2e631de72521 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:17.345363 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3146650e-4707-48ac-b011-2e631de72521 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:17.368372 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3146650e-4707-48ac-b011-2e631de72521 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:17.369480 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3146650e-4707-48ac-b011-2e631de72521 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:17.372866 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3146650e-4707-48ac-b011-2e631de72521 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:17.373811 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3146650e-4707-48ac-b011-2e631de72521 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:17.568822 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3146650e-4707-48ac-b011-2e631de72521 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:17.590167 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3146650e-4707-48ac-b011-2e631de72521 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:17.595349 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3146650e-4707-48ac-b011-2e631de72521 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:17.597597 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3146650e-4707-48ac-b011-2e631de72521 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.261672 Jul 26 17:15:17.598693 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 161/304] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:17 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:17.720239 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4eb68d3d-513f-4576-a364-0984655d27c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:17.730018 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4eb68d3d-513f-4576-a364-0984655d27c7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1509 microversion: 2.1 time: 0.612067 Jul 26 17:15:17.730875 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 144/305] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:17 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1509 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:17.776528 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-85225d8c-5f3b-48fd-8e21-298ac6785a57 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:17.777485 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-85225d8c-5f3b-48fd-8e21-298ac6785a57 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:17.786501 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85225d8c-5f3b-48fd-8e21-298ac6785a57 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:17.787248 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85225d8c-5f3b-48fd-8e21-298ac6785a57 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:17.788343 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85225d8c-5f3b-48fd-8e21-298ac6785a57 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:17.789480 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85225d8c-5f3b-48fd-8e21-298ac6785a57 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:17.990051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-85225d8c-5f3b-48fd-8e21-298ac6785a57 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:17.992095 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-965d8892-fa1e-41de-ac2e-da16035e3955 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:17.993041 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-965d8892-fa1e-41de-ac2e-da16035e3955 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] [instance: 4319adf0-b460-4b5f-9697-5a649f803c84] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:18.000240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-965d8892-fa1e-41de-ac2e-da16035e3955 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:18.000903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-965d8892-fa1e-41de-ac2e-da16035e3955 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:18.001720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-965d8892-fa1e-41de-ac2e-da16035e3955 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:18.002227 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-965d8892-fa1e-41de-ac2e-da16035e3955 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:18.007151 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-85225d8c-5f3b-48fd-8e21-298ac6785a57 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1318 microversion: 2.1 time: 0.235609 Jul 26 17:15:18.008797 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 162/306] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:17 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:18.025756 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-965d8892-fa1e-41de-ac2e-da16035e3955 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] HTTP exception thrown: Instance 4319adf0-b460-4b5f-9697-5a649f803c84 could not be found. Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-965d8892-fa1e-41de-ac2e-da16035e3955 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Request method failure captured: Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 HTTP/1.1 Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CD7u5jW6q36j6TOgRRr0NhXV6NfqSCyht-d4XwXZobEGrGk-LlxLN90h0icWfcJEwuWNInKd-q9J4ZpJor7JnuaHTA5CRXXcFQqaTLeLpgy5_KGUhYlgSVN1U4s82t-YsH1kmC6CWrUXMKighsfsSvOwoEJd_EQfEnJyynsLdN3EXk Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 396220daaf3f4a89aab4007f746b96ea Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-VolumesActionsTest-1138942481 Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:15:18.028240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:15:18.031587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/396220daaf3f4a89aab4007f746b96ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_396220daaf3f4a89aab4007f746b96ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/396220daaf3f4a89aab4007f746b96ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/396220daaf3f4a89aab4007f746b96ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:15:18.031587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-VolumesActionsTest-1138942481 Jul 26 17:15:18.031587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 396220daaf3f4a89aab4007f746b96ea Jul 26 17:15:18.031587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-VolumesActionsTest-1138942481 Jul 26 17:15:18.031587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-VolumesActionsTest-1138942481-project Jul 26 17:15:18.031587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:15:18.031587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:15:18.031587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: 8ce2731e0c8647c2a7ea29a0569d2a1d Jul 26 17:15:18.031587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-VolumesActionsTest-1138942481-project Jul 26 17:15:18.031587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:15:18.031587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 4319adf0-b460-4b5f-9697-5a649f803c84 could not be found. Jul 26 17:15:18.031587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '4319adf0-b460-4b5f-9697-5a649f803c84'} Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4319adf0-b460-4b5f-9697-5a649f803c84 could not be found. Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:15:18.033662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4319adf0-b460-4b5f-9697-5a649f803c84 could not be found. Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4319adf0-b460-4b5f-9697-5a649f803c84 could not be found. Jul 26 17:15:18.036030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:15:18.038281 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-965d8892-fa1e-41de-ac2e-da16035e3955 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] Returning 404 to user: Instance 4319adf0-b460-4b5f-9697-5a649f803c84 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:15:18.038281 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-965d8892-fa1e-41de-ac2e-da16035e3955 tempest-VolumesActionsTest-1138942481 tempest-VolumesActionsTest-1138942481-project] 10.222.0.48 "GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84" status: 404 len: 111 microversion: 2.1 time: 0.046165 Jul 26 17:15:18.038281 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 145/307] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:17 2022] GET /compute/v2.1/servers/4319adf0-b460-4b5f-9697-5a649f803c84 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 17:15:18.637636 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-52f7146b-04f0-47ce-8bd4-07fb584783f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:18.647779 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-52f7146b-04f0-47ce-8bd4-07fb584783f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:18.671827 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52f7146b-04f0-47ce-8bd4-07fb584783f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:18.672697 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52f7146b-04f0-47ce-8bd4-07fb584783f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:18.674008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52f7146b-04f0-47ce-8bd4-07fb584783f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:18.674773 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52f7146b-04f0-47ce-8bd4-07fb584783f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:18.755994 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-17ec0fa2-9ca3-4cb5-9abe-4305c003ebf1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:18.757301 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-17ec0fa2-9ca3-4cb5-9abe-4305c003ebf1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:18.768421 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-17ec0fa2-9ca3-4cb5-9abe-4305c003ebf1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:18.769202 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-17ec0fa2-9ca3-4cb5-9abe-4305c003ebf1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:18.770379 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-17ec0fa2-9ca3-4cb5-9abe-4305c003ebf1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:18.771041 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-17ec0fa2-9ca3-4cb5-9abe-4305c003ebf1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:18.958428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-17ec0fa2-9ca3-4cb5-9abe-4305c003ebf1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:18.967642 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-17ec0fa2-9ca3-4cb5-9abe-4305c003ebf1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1509 microversion: 2.1 time: 0.216333 Jul 26 17:15:18.968863 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 146/308] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:18 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:19.041375 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-590be26c-fe26-426b-8458-6b1b9182a306 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:19.042855 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-590be26c-fe26-426b-8458-6b1b9182a306 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:19.062300 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-52f7146b-04f0-47ce-8bd4-07fb584783f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:19.067212 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-590be26c-fe26-426b-8458-6b1b9182a306 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:19.068128 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-590be26c-fe26-426b-8458-6b1b9182a306 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:19.069592 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-590be26c-fe26-426b-8458-6b1b9182a306 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:19.070382 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-590be26c-fe26-426b-8458-6b1b9182a306 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:19.089867 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-52f7146b-04f0-47ce-8bd4-07fb584783f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:19.095026 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-52f7146b-04f0-47ce-8bd4-07fb584783f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:19.096844 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-52f7146b-04f0-47ce-8bd4-07fb584783f5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.475830 Jul 26 17:15:19.098245 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 163/309] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:18 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:19.321201 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-590be26c-fe26-426b-8458-6b1b9182a306 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:19.335070 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-590be26c-fe26-426b-8458-6b1b9182a306 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1318 microversion: 2.1 time: 0.306730 Jul 26 17:15:19.335805 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 147/310] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:19 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:19.677946 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-294241982", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "734c8f5e-6756-4577-8da6-4e85b95dd0b0"}], "security_groups": [{"name": "tempest-securitygroup--1816623732"}], "key_name": "tempest-keypair-630634567", "user_data": "}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:19.817441 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] validate_networks() for [('734c8f5e-6756-4577-8da6-4e85b95dd0b0', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:15:20.007396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-69dbadc6-7e41-4738-a25e-7fee615716e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:20.008019 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-69dbadc6-7e41-4738-a25e-7fee615716e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:20.016058 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-69dbadc6-7e41-4738-a25e-7fee615716e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:20.016508 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-69dbadc6-7e41-4738-a25e-7fee615716e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:20.018086 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-69dbadc6-7e41-4738-a25e-7fee615716e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:20.018086 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-69dbadc6-7e41-4738-a25e-7fee615716e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:20.205681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-69dbadc6-7e41-4738-a25e-7fee615716e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:20.213661 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-69dbadc6-7e41-4738-a25e-7fee615716e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1509 microversion: 2.1 time: 0.210783 Jul 26 17:15:20.229616 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 148/311] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:20 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:20.237002 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5bde9229-7790-472b-a29d-0fc48e04dc2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:20.237657 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5bde9229-7790-472b-a29d-0fc48e04dc2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:20.246207 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5bde9229-7790-472b-a29d-0fc48e04dc2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:20.246829 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5bde9229-7790-472b-a29d-0fc48e04dc2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:20.248435 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5bde9229-7790-472b-a29d-0fc48e04dc2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:20.249083 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5bde9229-7790-472b-a29d-0fc48e04dc2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:20.517268 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5bde9229-7790-472b-a29d-0fc48e04dc2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:20.527861 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5bde9229-7790-472b-a29d-0fc48e04dc2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:20.532113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5bde9229-7790-472b-a29d-0fc48e04dc2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:20.533657 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5bde9229-7790-472b-a29d-0fc48e04dc2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.302336 Jul 26 17:15:20.547132 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 149/312] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:20 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:20.548378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e9c75fb8-3e70-47d2-ac89-1ec94d20c617 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:20.549493 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-e9c75fb8-3e70-47d2-ac89-1ec94d20c617 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:20.556761 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e9c75fb8-3e70-47d2-ac89-1ec94d20c617 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:20.558551 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e9c75fb8-3e70-47d2-ac89-1ec94d20c617 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:20.559443 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e9c75fb8-3e70-47d2-ac89-1ec94d20c617 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:20.561980 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e9c75fb8-3e70-47d2-ac89-1ec94d20c617 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:20.758609 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:15:20.761869 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:15:20.765449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:15:20.766242 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:15:20.767059 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:15:20.780797 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:20.781576 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:20.783657 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:20.784515 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:20.805826 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e9c75fb8-3e70-47d2-ac89-1ec94d20c617 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:20.815839 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:15:20.821769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for user c6291932ceb84b03924c0f056f29c2a9 and project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:15:20.822168 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e9c75fb8-3e70-47d2-ac89-1ec94d20c617 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1318 microversion: 2.1 time: 0.286087 Jul 26 17:15:20.825029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 150/313] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:20 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:20.846352 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:15:20.848743 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:15:20.913304 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-65bbf55f-d509-40c4-a55a-8dd67c54de2c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.237743 Jul 26 17:15:20.914619 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 164/314] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:15:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:15:20.934910 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8e09e07d-cc1b-4965-84aa-97a79e0e555a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:20.936099 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8e09e07d-cc1b-4965-84aa-97a79e0e555a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:21.020716 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8e09e07d-cc1b-4965-84aa-97a79e0e555a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:21.036029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8e09e07d-cc1b-4965-84aa-97a79e0e555a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1240 microversion: 2.1 time: 0.111460 Jul 26 17:15:21.037924 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 151/315] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:20 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1240 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:21.246862 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fc5db149-898c-4a31-90a7-ad79c9bd0d84 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:21.248408 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fc5db149-898c-4a31-90a7-ad79c9bd0d84 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:21.256901 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc5db149-898c-4a31-90a7-ad79c9bd0d84 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:21.257830 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc5db149-898c-4a31-90a7-ad79c9bd0d84 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:21.259461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc5db149-898c-4a31-90a7-ad79c9bd0d84 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:21.260426 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc5db149-898c-4a31-90a7-ad79c9bd0d84 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:21.467594 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fc5db149-898c-4a31-90a7-ad79c9bd0d84 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:21.486212 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fc5db149-898c-4a31-90a7-ad79c9bd0d84 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1509 microversion: 2.1 time: 0.245710 Jul 26 17:15:21.505947 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 165/316] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:21 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:21.572295 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a05633e5-96f9-4c88-89e5-5c0c400b2649 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:21.573375 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a05633e5-96f9-4c88-89e5-5c0c400b2649 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:21.587728 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a05633e5-96f9-4c88-89e5-5c0c400b2649 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:21.588511 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a05633e5-96f9-4c88-89e5-5c0c400b2649 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:21.590198 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a05633e5-96f9-4c88-89e5-5c0c400b2649 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:21.591160 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a05633e5-96f9-4c88-89e5-5c0c400b2649 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:21.794983 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e42e729b-812d-4d07-a6ba-4ef129bb84c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:21.797109 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e42e729b-812d-4d07-a6ba-4ef129bb84c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:21.813199 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e42e729b-812d-4d07-a6ba-4ef129bb84c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:21.813857 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e42e729b-812d-4d07-a6ba-4ef129bb84c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:21.815321 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e42e729b-812d-4d07-a6ba-4ef129bb84c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:21.816468 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e42e729b-812d-4d07-a6ba-4ef129bb84c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:21.826387 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a05633e5-96f9-4c88-89e5-5c0c400b2649 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:21.843392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a05633e5-96f9-4c88-89e5-5c0c400b2649 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:21.846439 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a05633e5-96f9-4c88-89e5-5c0c400b2649 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:21.848754 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a05633e5-96f9-4c88-89e5-5c0c400b2649 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.285125 Jul 26 17:15:21.850230 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 152/317] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:21 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:21.859428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1b5673e0-21c5-4eb7-8709-06687b7336dc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:21.860500 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1b5673e0-21c5-4eb7-8709-06687b7336dc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:21.871028 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b5673e0-21c5-4eb7-8709-06687b7336dc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:21.871743 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b5673e0-21c5-4eb7-8709-06687b7336dc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:21.873972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b5673e0-21c5-4eb7-8709-06687b7336dc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:21.875018 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b5673e0-21c5-4eb7-8709-06687b7336dc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:21.881649 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e42e729b-812d-4d07-a6ba-4ef129bb84c8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/ips" status: 200 len: 145 microversion: 2.1 time: 0.093340 Jul 26 17:15:21.884001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 166/318] 10.222.0.48 () {58 vars in 1248 bytes} [Tue Jul 26 17:15:21 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/ips => generated 145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:15:22.059019 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-99545f17-f082-4565-ae19-4edc8415cb26 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:22.059631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-99545f17-f082-4565-ae19-4edc8415cb26 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:22.066901 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99545f17-f082-4565-ae19-4edc8415cb26 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:22.067344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99545f17-f082-4565-ae19-4edc8415cb26 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:22.068110 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99545f17-f082-4565-ae19-4edc8415cb26 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:22.068715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99545f17-f082-4565-ae19-4edc8415cb26 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:22.072292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1b5673e0-21c5-4eb7-8709-06687b7336dc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:22.093129 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1b5673e0-21c5-4eb7-8709-06687b7336dc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1318 microversion: 2.1 time: 0.240844 Jul 26 17:15:22.094054 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 153/319] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:21 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:22.136952 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-99545f17-f082-4565-ae19-4edc8415cb26 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:22.152587 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-99545f17-f082-4565-ae19-4edc8415cb26 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1244 microversion: 2.1 time: 0.096897 Jul 26 17:15:22.153900 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 167/320] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:22 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:22.517292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-43398dae-f8e2-4c04-b83c-3dd3cb3142c4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:22.517906 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-43398dae-f8e2-4c04-b83c-3dd3cb3142c4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:22.525013 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-43398dae-f8e2-4c04-b83c-3dd3cb3142c4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:22.525722 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-43398dae-f8e2-4c04-b83c-3dd3cb3142c4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:22.526663 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-43398dae-f8e2-4c04-b83c-3dd3cb3142c4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:22.527286 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-43398dae-f8e2-4c04-b83c-3dd3cb3142c4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:22.698329 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-43398dae-f8e2-4c04-b83c-3dd3cb3142c4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:22.707863 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-43398dae-f8e2-4c04-b83c-3dd3cb3142c4 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1509 microversion: 2.1 time: 0.194976 Jul 26 17:15:22.708688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 154/321] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:22 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:22.874546 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7cbf976f-1572-4947-b0c0-5886474e984e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:22.875904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7cbf976f-1572-4947-b0c0-5886474e984e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:22.884081 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7cbf976f-1572-4947-b0c0-5886474e984e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:22.885141 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7cbf976f-1572-4947-b0c0-5886474e984e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:22.886190 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7cbf976f-1572-4947-b0c0-5886474e984e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:22.886848 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7cbf976f-1572-4947-b0c0-5886474e984e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:23.085234 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7cbf976f-1572-4947-b0c0-5886474e984e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:23.095221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7cbf976f-1572-4947-b0c0-5886474e984e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:23.097616 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7cbf976f-1572-4947-b0c0-5886474e984e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:23.099126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7cbf976f-1572-4947-b0c0-5886474e984e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.229963 Jul 26 17:15:23.100212 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 168/322] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:22 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:23.127325 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6753aefd-989a-4d54-b57e-ae12386b1cf6 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:23.133583 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6753aefd-989a-4d54-b57e-ae12386b1cf6 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:23.143449 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6753aefd-989a-4d54-b57e-ae12386b1cf6 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:23.144804 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6753aefd-989a-4d54-b57e-ae12386b1cf6 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:23.146171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6753aefd-989a-4d54-b57e-ae12386b1cf6 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:23.146832 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6753aefd-989a-4d54-b57e-ae12386b1cf6 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:23.155120 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:23.186349 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3c0781de-a0e6-4419-896b-e643202149d4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:23.187953 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3c0781de-a0e6-4419-896b-e643202149d4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:23.225254 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c0781de-a0e6-4419-896b-e643202149d4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:23.230111 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c0781de-a0e6-4419-896b-e643202149d4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:23.233474 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c0781de-a0e6-4419-896b-e643202149d4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:23.239809 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c0781de-a0e6-4419-896b-e643202149d4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:23.364661 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3c0781de-a0e6-4419-896b-e643202149d4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:23.366469 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6753aefd-989a-4d54-b57e-ae12386b1cf6 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:23.375843 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3c0781de-a0e6-4419-896b-e643202149d4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1236 microversion: 2.1 time: 0.200107 Jul 26 17:15:23.376781 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 169/323] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:23 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1236 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:23.379059 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6753aefd-989a-4d54-b57e-ae12386b1cf6 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1318 microversion: 2.1 time: 0.263777 Jul 26 17:15:23.379889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 155/324] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:23 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:23.734252 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fe10169f-0cfa-45a6-8114-77d0b6233128 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:23.735867 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fe10169f-0cfa-45a6-8114-77d0b6233128 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:23.764133 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe10169f-0cfa-45a6-8114-77d0b6233128 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:23.768266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe10169f-0cfa-45a6-8114-77d0b6233128 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:23.770570 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe10169f-0cfa-45a6-8114-77d0b6233128 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:23.771508 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe10169f-0cfa-45a6-8114-77d0b6233128 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:23.976772 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fe10169f-0cfa-45a6-8114-77d0b6233128 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:23.996462 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fe10169f-0cfa-45a6-8114-77d0b6233128 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1515 microversion: 2.1 time: 0.269204 Jul 26 17:15:23.998677 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 170/325] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:23 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1515 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:24.129250 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-421b5ea8-1c2e-475a-90cf-487da912929f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:24.130133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-421b5ea8-1c2e-475a-90cf-487da912929f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:24.155312 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-421b5ea8-1c2e-475a-90cf-487da912929f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:24.156235 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-421b5ea8-1c2e-475a-90cf-487da912929f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:24.157801 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-421b5ea8-1c2e-475a-90cf-487da912929f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:24.158572 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-421b5ea8-1c2e-475a-90cf-487da912929f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:24.327811 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9fc3ff4f-6e65-4b9d-ae8c-2dae2f80e17e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b99c35a5-1f4e-4fd2-9cf0-c9b421e42e49"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:24.334754 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9fc3ff4f-6e65-4b9d-ae8c-2dae2f80e17e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:24.347897 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9fc3ff4f-6e65-4b9d-ae8c-2dae2f80e17e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:24.349293 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9fc3ff4f-6e65-4b9d-ae8c-2dae2f80e17e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:24.350802 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9fc3ff4f-6e65-4b9d-ae8c-2dae2f80e17e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:24.351971 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9fc3ff4f-6e65-4b9d-ae8c-2dae2f80e17e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:24.564025 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-421b5ea8-1c2e-475a-90cf-487da912929f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:24.599229 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-421b5ea8-1c2e-475a-90cf-487da912929f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:24.604332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-421b5ea8-1c2e-475a-90cf-487da912929f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:24.608029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-421b5ea8-1c2e-475a-90cf-487da912929f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.485190 Jul 26 17:15:24.614241 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 156/326] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:24 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:24.647283 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d9dfa8e7-5098-4ab6-a6ab-8f42caf91e6b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:24.648902 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d9dfa8e7-5098-4ab6-a6ab-8f42caf91e6b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:24.670222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d9dfa8e7-5098-4ab6-a6ab-8f42caf91e6b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:24.670835 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d9dfa8e7-5098-4ab6-a6ab-8f42caf91e6b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:24.671803 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d9dfa8e7-5098-4ab6-a6ab-8f42caf91e6b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:24.676554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d9dfa8e7-5098-4ab6-a6ab-8f42caf91e6b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:24.907917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d9dfa8e7-5098-4ab6-a6ab-8f42caf91e6b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:24.930636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d9dfa8e7-5098-4ab6-a6ab-8f42caf91e6b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1300 microversion: 2.1 time: 0.310288 Jul 26 17:15:24.932275 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 157/327] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:24 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1300 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:24.955056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-803556fd-5f1c-4bd6-9064-505c21d70d83 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:24.959012 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-803556fd-5f1c-4bd6-9064-505c21d70d83 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:24.974265 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-803556fd-5f1c-4bd6-9064-505c21d70d83 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:24.978894 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-803556fd-5f1c-4bd6-9064-505c21d70d83 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:24.980405 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-803556fd-5f1c-4bd6-9064-505c21d70d83 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:24.987180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-803556fd-5f1c-4bd6-9064-505c21d70d83 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:25.068418 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9fc3ff4f-6e65-4b9d-ae8c-2dae2f80e17e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "POST /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.736909 Jul 26 17:15:25.078301 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 171/328] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:15:24 2022] POST /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:15:25.163543 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-57e56215-eb12-4f19-966d-1ff0739ee6b2 req-ba378959-1428-4298-9592-684601d8d041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4c1664-d4a2-4f59-8f45-2025f237a3cc", "name": "network-vif-plugged", "status": "completed", "tag": "bfe45947-fc60-41ad-a94c-7cdebb82c3a9"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:25.226737 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-57e56215-eb12-4f19-966d-1ff0739ee6b2 req-ba378959-1428-4298-9592-684601d8d041 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:25.230150 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-57e56215-eb12-4f19-966d-1ff0739ee6b2 req-ba378959-1428-4298-9592-684601d8d041 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:25.283011 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-57e56215-eb12-4f19-966d-1ff0739ee6b2 req-ba378959-1428-4298-9592-684601d8d041 service nova] Creating event network-vif-plugged:bfe45947-fc60-41ad-a94c-7cdebb82c3a9 for instance af4c1664-d4a2-4f59-8f45-2025f237a3cc on hv-cinder-83538 Jul 26 17:15:25.299517 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-57e56215-eb12-4f19-966d-1ff0739ee6b2 req-ba378959-1428-4298-9592-684601d8d041 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140061 Jul 26 17:15:25.302064 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 172/329] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:15:25.322911 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-803556fd-5f1c-4bd6-9064-505c21d70d83 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:25.335120 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-803556fd-5f1c-4bd6-9064-505c21d70d83 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1318 microversion: 2.1 time: 0.400890 Jul 26 17:15:25.336222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 158/330] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:24 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:25.646310 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ff31268-4faa-470a-aefd-00eb01000e40 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:25.647465 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ff31268-4faa-470a-aefd-00eb01000e40 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:25.683335 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ff31268-4faa-470a-aefd-00eb01000e40 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:25.686378 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ff31268-4faa-470a-aefd-00eb01000e40 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:25.687462 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ff31268-4faa-470a-aefd-00eb01000e40 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:25.688177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ff31268-4faa-470a-aefd-00eb01000e40 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:25.886387 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-828f1e43-21f9-4c4c-87e4-10b8a1f45958 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Action: 'create', calling method: .version_select at 0x7f6ca9483940>, body: {"keypair": {"name": "tempest-keypair-1252820637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyXRAeBBPYcI9w0vySmLZmHmNJaC1JwU4m1SJ3IXVE0vz5EEENsS4taJLUU6cG+hXAgAAQS8bYtb3HSOpMt1oHavEVZCBJqTUP5eNfHrseAlS8wD1Mz/JYXlEvP34kBxw=="}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:25.941394 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-828f1e43-21f9-4c4c-87e4-10b8a1f45958 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Getting quotas for project 2b8b6c88af94417c840fdafd1fe431b7. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:15:25.969251 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-828f1e43-21f9-4c4c-87e4-10b8a1f45958 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Getting quotas for user 97115d07acc5464bb7b097039471fee6 and project 2b8b6c88af94417c840fdafd1fe431b7. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:15:26.062161 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-828f1e43-21f9-4c4c-87e4-10b8a1f45958 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181147 Jul 26 17:15:26.066335 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 159/331] 10.222.0.48 () {60 vars in 1159 bytes} [Tue Jul 26 17:15:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:15:26.091757 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3876866e-707b-408e-b046-91452334c8c9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:26.093045 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3876866e-707b-408e-b046-91452334c8c9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:26.135495 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3876866e-707b-408e-b046-91452334c8c9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:26.141441 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3876866e-707b-408e-b046-91452334c8c9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:26.145311 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3876866e-707b-408e-b046-91452334c8c9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:26.146311 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3876866e-707b-408e-b046-91452334c8c9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:26.210934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ff31268-4faa-470a-aefd-00eb01000e40 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:26.232558 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ff31268-4faa-470a-aefd-00eb01000e40 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:26.247881 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ff31268-4faa-470a-aefd-00eb01000e40 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:26.250651 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ff31268-4faa-470a-aefd-00eb01000e40 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.609626 Jul 26 17:15:26.254062 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 173/332] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:25 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:26.344690 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3876866e-707b-408e-b046-91452334c8c9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:26.359450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3876866e-707b-408e-b046-91452334c8c9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1298 microversion: 2.1 time: 0.288441 Jul 26 17:15:26.361139 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 160/333] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:26 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1298 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:26.394150 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6fffc0ee-402e-4ec4-ae2a-3e7c01e380ea tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:26.396674 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6fffc0ee-402e-4ec4-ae2a-3e7c01e380ea tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:26.427972 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:26.434576 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fffc0ee-402e-4ec4-ae2a-3e7c01e380ea tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:26.438100 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fffc0ee-402e-4ec4-ae2a-3e7c01e380ea tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:26.439622 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fffc0ee-402e-4ec4-ae2a-3e7c01e380ea tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:26.443072 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fffc0ee-402e-4ec4-ae2a-3e7c01e380ea tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:26.763738 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6fffc0ee-402e-4ec4-ae2a-3e7c01e380ea tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:26.784195 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6fffc0ee-402e-4ec4-ae2a-3e7c01e380ea tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1318 microversion: 2.1 time: 0.398044 Jul 26 17:15:26.801561 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 174/334] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:26 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:27.276880 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d74446d0-9300-416f-915a-d714f637de92 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:27.278112 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d74446d0-9300-416f-915a-d714f637de92 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:27.291566 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d74446d0-9300-416f-915a-d714f637de92 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:27.292550 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d74446d0-9300-416f-915a-d714f637de92 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:27.293760 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d74446d0-9300-416f-915a-d714f637de92 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:27.294585 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d74446d0-9300-416f-915a-d714f637de92 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:27.384121 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ba92b6f9-5d95-4916-983b-faf2e4012770 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:27.384938 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ba92b6f9-5d95-4916-983b-faf2e4012770 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:27.397960 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba92b6f9-5d95-4916-983b-faf2e4012770 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:27.400377 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba92b6f9-5d95-4916-983b-faf2e4012770 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:27.401733 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba92b6f9-5d95-4916-983b-faf2e4012770 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:27.407568 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba92b6f9-5d95-4916-983b-faf2e4012770 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:27.888747 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ba92b6f9-5d95-4916-983b-faf2e4012770 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:27.918637 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ba92b6f9-5d95-4916-983b-faf2e4012770 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1366 microversion: 2.1 time: 0.539928 Jul 26 17:15:27.929289 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 175/335] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:27 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1366 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:27.943591 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-934de0d7-a52d-4ac5-8ec4-5ebfb16abb2f tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:27.951781 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-934de0d7-a52d-4ac5-8ec4-5ebfb16abb2f tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:27.978047 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-934de0d7-a52d-4ac5-8ec4-5ebfb16abb2f tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:27.979932 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-934de0d7-a52d-4ac5-8ec4-5ebfb16abb2f tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:27.987096 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-934de0d7-a52d-4ac5-8ec4-5ebfb16abb2f tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:27.990107 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-934de0d7-a52d-4ac5-8ec4-5ebfb16abb2f tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:28.189782 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d74446d0-9300-416f-915a-d714f637de92 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:28.238406 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d74446d0-9300-416f-915a-d714f637de92 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:28.244046 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d74446d0-9300-416f-915a-d714f637de92 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:28.247235 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d74446d0-9300-416f-915a-d714f637de92 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.974798 Jul 26 17:15:28.250932 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 161/336] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:27 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:28.474635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-934de0d7-a52d-4ac5-8ec4-5ebfb16abb2f tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:28.479242 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:28.505786 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-934de0d7-a52d-4ac5-8ec4-5ebfb16abb2f tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1505 microversion: 2.1 time: 0.574169 Jul 26 17:15:28.508804 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 176/337] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:27 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1505 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:28.969519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-393e533c-0c77-4e40-b7dd-4ee6c10ef169 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:28.970242 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-393e533c-0c77-4e40-b7dd-4ee6c10ef169 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:29.014438 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-393e533c-0c77-4e40-b7dd-4ee6c10ef169 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:29.018103 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-393e533c-0c77-4e40-b7dd-4ee6c10ef169 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:29.024898 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-393e533c-0c77-4e40-b7dd-4ee6c10ef169 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:29.032350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-393e533c-0c77-4e40-b7dd-4ee6c10ef169 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:29.301413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be5dc7eb-7727-403b-b8c0-4f3efbe24a5c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:29.302543 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be5dc7eb-7727-403b-b8c0-4f3efbe24a5c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:29.351532 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be5dc7eb-7727-403b-b8c0-4f3efbe24a5c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:29.367897 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be5dc7eb-7727-403b-b8c0-4f3efbe24a5c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:29.376605 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be5dc7eb-7727-403b-b8c0-4f3efbe24a5c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:29.378733 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be5dc7eb-7727-403b-b8c0-4f3efbe24a5c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:29.642611 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-393e533c-0c77-4e40-b7dd-4ee6c10ef169 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:29.655097 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-393e533c-0c77-4e40-b7dd-4ee6c10ef169 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1366 microversion: 2.1 time: 0.692516 Jul 26 17:15:29.659000 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 162/338] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:28 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1366 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:29.765194 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-acc9c0bd-940f-4832-99c4-3b03e69e0317 req-854cfcd5-331a-4601-aaf6-3c5c3b04b3df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db19722e-e060-4323-8b57-179687e601d6", "tag": "b046591b-0a3b-41bc-908a-5b12dbcf6b04"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:29.788582 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-acc9c0bd-940f-4832-99c4-3b03e69e0317 req-854cfcd5-331a-4601-aaf6-3c5c3b04b3df service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:29.799074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-acc9c0bd-940f-4832-99c4-3b03e69e0317 req-854cfcd5-331a-4601-aaf6-3c5c3b04b3df service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:29.943527 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be5dc7eb-7727-403b-b8c0-4f3efbe24a5c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:29.971630 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be5dc7eb-7727-403b-b8c0-4f3efbe24a5c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:29.990021 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be5dc7eb-7727-403b-b8c0-4f3efbe24a5c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:29.999351 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be5dc7eb-7727-403b-b8c0-4f3efbe24a5c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1746 microversion: 2.20 time: 0.706621 Jul 26 17:15:30.005056 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 177/339] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:29 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1746 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:30.393640 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-acc9c0bd-940f-4832-99c4-3b03e69e0317 req-854cfcd5-331a-4601-aaf6-3c5c3b04b3df service nova] Creating event network-changed:b046591b-0a3b-41bc-908a-5b12dbcf6b04 for instance db19722e-e060-4323-8b57-179687e601d6 on hv-cinder-83538 Jul 26 17:15:30.400943 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-acc9c0bd-940f-4832-99c4-3b03e69e0317 req-854cfcd5-331a-4601-aaf6-3c5c3b04b3df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.639818 Jul 26 17:15:30.402001 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 163/340] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:15:30.691784 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c4fc0dc7-113e-4be3-a975-e5f5aa258963 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:30.708456 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c4fc0dc7-113e-4be3-a975-e5f5aa258963 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:30.784469 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4fc0dc7-113e-4be3-a975-e5f5aa258963 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:30.784952 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4fc0dc7-113e-4be3-a975-e5f5aa258963 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:30.786026 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4fc0dc7-113e-4be3-a975-e5f5aa258963 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:30.786329 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4fc0dc7-113e-4be3-a975-e5f5aa258963 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:30.805539 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:30.842627 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=10 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:30.942042 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1444245678", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0af083cb-d1e4-488d-8d25-6adac66e506d"}], "security_groups": [{"name": "tempest-securitygroup--1348737936"}], "key_name": "tempest-keypair-1252820637", "user_data": "}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:31.080341 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c4fc0dc7-113e-4be3-a975-e5f5aa258963 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:31.091828 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c4fc0dc7-113e-4be3-a975-e5f5aa258963 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1366 microversion: 2.1 time: 0.407655 Jul 26 17:15:31.098420 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 178/341] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:30 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:31.103864 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bc27953c-717a-41c9-b74c-a806abd519af tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:31.109881 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bc27953c-717a-41c9-b74c-a806abd519af tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:31.128345 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc27953c-717a-41c9-b74c-a806abd519af tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:31.129280 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc27953c-717a-41c9-b74c-a806abd519af tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:31.130323 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc27953c-717a-41c9-b74c-a806abd519af tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:31.130942 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc27953c-717a-41c9-b74c-a806abd519af tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:31.452605 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bc27953c-717a-41c9-b74c-a806abd519af tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:31.475620 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bc27953c-717a-41c9-b74c-a806abd519af tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:31.489187 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bc27953c-717a-41c9-b74c-a806abd519af tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:31.491189 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bc27953c-717a-41c9-b74c-a806abd519af tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.391314 Jul 26 17:15:31.508830 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 179/342] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:31 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:31.605876 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-c99a66d9-a06b-4832-9ef2-3e513d67a917 req-ba628943-c81f-4a36-9cce-c6ee464e6271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7d66fd-65f0-4c03-8f1e-93d1ec23d411", "name": "network-vif-plugged", "status": "completed", "tag": "5a304d69-32d1-40aa-b33c-fe4e3d47a965"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:31.639878 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-c99a66d9-a06b-4832-9ef2-3e513d67a917 req-ba628943-c81f-4a36-9cce-c6ee464e6271 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:31.641515 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-c99a66d9-a06b-4832-9ef2-3e513d67a917 req-ba628943-c81f-4a36-9cce-c6ee464e6271 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:31.667577 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-c99a66d9-a06b-4832-9ef2-3e513d67a917 req-ba628943-c81f-4a36-9cce-c6ee464e6271 service nova] Creating event network-vif-plugged:5a304d69-32d1-40aa-b33c-fe4e3d47a965 for instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 on hv-cinder-83538 Jul 26 17:15:31.675443 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-c99a66d9-a06b-4832-9ef2-3e513d67a917 req-ba628943-c81f-4a36-9cce-c6ee464e6271 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075647 Jul 26 17:15:31.676947 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 180/343] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:15:32.148461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e179028b-e0ec-4c11-87ef-666f6a097245 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:32.149728 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e179028b-e0ec-4c11-87ef-666f6a097245 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:32.160995 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e179028b-e0ec-4c11-87ef-666f6a097245 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:32.161763 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e179028b-e0ec-4c11-87ef-666f6a097245 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:32.163022 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e179028b-e0ec-4c11-87ef-666f6a097245 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:32.163746 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e179028b-e0ec-4c11-87ef-666f6a097245 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:32.343822 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e179028b-e0ec-4c11-87ef-666f6a097245 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:32.359001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e179028b-e0ec-4c11-87ef-666f6a097245 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1366 microversion: 2.1 time: 0.218284 Jul 26 17:15:32.360438 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 181/344] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:32 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:32.519873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6e8112db-92fb-4d5d-adc4-3b6b5ae63e88 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:32.520537 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6e8112db-92fb-4d5d-adc4-3b6b5ae63e88 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:32.528039 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e8112db-92fb-4d5d-adc4-3b6b5ae63e88 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:32.528929 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e8112db-92fb-4d5d-adc4-3b6b5ae63e88 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:32.530684 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e8112db-92fb-4d5d-adc4-3b6b5ae63e88 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:32.531505 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e8112db-92fb-4d5d-adc4-3b6b5ae63e88 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:32.733308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6e8112db-92fb-4d5d-adc4-3b6b5ae63e88 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:32.744653 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6e8112db-92fb-4d5d-adc4-3b6b5ae63e88 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:32.746821 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6e8112db-92fb-4d5d-adc4-3b6b5ae63e88 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:32.749300 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6e8112db-92fb-4d5d-adc4-3b6b5ae63e88 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.234004 Jul 26 17:15:32.749879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 182/345] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:32 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:33.392247 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-81fcdda8-d363-41e8-813d-4d7cc5334c05 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:33.392872 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-81fcdda8-d363-41e8-813d-4d7cc5334c05 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:33.408017 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81fcdda8-d363-41e8-813d-4d7cc5334c05 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:33.409719 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81fcdda8-d363-41e8-813d-4d7cc5334c05 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:33.412395 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81fcdda8-d363-41e8-813d-4d7cc5334c05 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:33.413083 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81fcdda8-d363-41e8-813d-4d7cc5334c05 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:33.662440 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-81fcdda8-d363-41e8-813d-4d7cc5334c05 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:33.671995 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-81fcdda8-d363-41e8-813d-4d7cc5334c05 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1366 microversion: 2.1 time: 0.283902 Jul 26 17:15:33.673153 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 183/346] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:33 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:33.778013 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-567380f5-e8e7-4ea3-84ea-e115ea005779 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:33.778749 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-567380f5-e8e7-4ea3-84ea-e115ea005779 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:33.785395 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-567380f5-e8e7-4ea3-84ea-e115ea005779 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:33.785840 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-567380f5-e8e7-4ea3-84ea-e115ea005779 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:33.786630 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-567380f5-e8e7-4ea3-84ea-e115ea005779 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:33.787307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-567380f5-e8e7-4ea3-84ea-e115ea005779 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:33.978925 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-567380f5-e8e7-4ea3-84ea-e115ea005779 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:33.990152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-567380f5-e8e7-4ea3-84ea-e115ea005779 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:33.991916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-567380f5-e8e7-4ea3-84ea-e115ea005779 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:33.993408 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-567380f5-e8e7-4ea3-84ea-e115ea005779 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.219724 Jul 26 17:15:33.994487 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 184/347] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:33 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:34.726121 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79dacf4f-0272-448b-9eb6-45eb2d3fe68e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:34.730340 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79dacf4f-0272-448b-9eb6-45eb2d3fe68e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:34.773551 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79dacf4f-0272-448b-9eb6-45eb2d3fe68e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:34.775595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79dacf4f-0272-448b-9eb6-45eb2d3fe68e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:34.782787 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79dacf4f-0272-448b-9eb6-45eb2d3fe68e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:34.783343 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79dacf4f-0272-448b-9eb6-45eb2d3fe68e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:35.077393 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79dacf4f-0272-448b-9eb6-45eb2d3fe68e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:35.089676 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79dacf4f-0272-448b-9eb6-45eb2d3fe68e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1366 microversion: 2.1 time: 0.383627 Jul 26 17:15:35.105443 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 185/348] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:34 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:35.115775 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-eae3a07d-890d-462e-bf2f-0604caa54119 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:35.127000 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eae3a07d-890d-462e-bf2f-0604caa54119 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:35.127648 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eae3a07d-890d-462e-bf2f-0604caa54119 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:35.243537 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-eae3a07d-890d-462e-bf2f-0604caa54119 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Going to try to stop instance {{(pid=118121) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 17:15:35.374230 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-eae3a07d-890d-462e-bf2f-0604caa54119 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "POST /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/action" status: 202 len: 0 microversion: 2.1 time: 0.265327 Jul 26 17:15:35.375968 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 186/349] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:15:35 2022] POST /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:15:35.385794 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-25be7bb2-70b7-45d4-a2eb-753c344e47ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:35.386707 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-25be7bb2-70b7-45d4-a2eb-753c344e47ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:35.415559 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25be7bb2-70b7-45d4-a2eb-753c344e47ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:35.419315 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25be7bb2-70b7-45d4-a2eb-753c344e47ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:35.420937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25be7bb2-70b7-45d4-a2eb-753c344e47ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:35.421749 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25be7bb2-70b7-45d4-a2eb-753c344e47ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:35.675600 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-25be7bb2-70b7-45d4-a2eb-753c344e47ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:35.689674 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-25be7bb2-70b7-45d4-a2eb-753c344e47ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:35.691576 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-25be7bb2-70b7-45d4-a2eb-753c344e47ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:35.692921 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-25be7bb2-70b7-45d4-a2eb-753c344e47ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.315127 Jul 26 17:15:35.705689 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 187/350] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:35 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:35.705689 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-88b03a94-6d2d-4e1e-8768-02b7afcf59e8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:35.705689 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-88b03a94-6d2d-4e1e-8768-02b7afcf59e8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:35.707562 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88b03a94-6d2d-4e1e-8768-02b7afcf59e8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:35.708731 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88b03a94-6d2d-4e1e-8768-02b7afcf59e8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:35.709810 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88b03a94-6d2d-4e1e-8768-02b7afcf59e8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:35.711102 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88b03a94-6d2d-4e1e-8768-02b7afcf59e8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:35.878898 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-88b03a94-6d2d-4e1e-8768-02b7afcf59e8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:35.893331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-88b03a94-6d2d-4e1e-8768-02b7afcf59e8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1723 microversion: 2.1 time: 0.198221 Jul 26 17:15:35.894390 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 188/351] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:35 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:35.900335 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-5a5b0c67-494a-45af-baef-876690a28898 req-83088dfe-57ce-4e0c-b986-157254767236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db19722e-e060-4323-8b57-179687e601d6", "name": "network-vif-plugged", "status": "completed", "tag": "b046591b-0a3b-41bc-908a-5b12dbcf6b04"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:35.911011 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-5a5b0c67-494a-45af-baef-876690a28898 req-83088dfe-57ce-4e0c-b986-157254767236 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:35.911456 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-5a5b0c67-494a-45af-baef-876690a28898 req-83088dfe-57ce-4e0c-b986-157254767236 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:35.924114 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-5a5b0c67-494a-45af-baef-876690a28898 req-83088dfe-57ce-4e0c-b986-157254767236 service nova] Creating event network-vif-plugged:b046591b-0a3b-41bc-908a-5b12dbcf6b04 for instance db19722e-e060-4323-8b57-179687e601d6 on hv-cinder-83538 Jul 26 17:15:35.929473 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-5a5b0c67-494a-45af-baef-876690a28898 req-83088dfe-57ce-4e0c-b986-157254767236 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032709 Jul 26 17:15:35.930149 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 189/352] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:15:35.986826 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=6 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:36.118624 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9fad0265-3f86-4cfe-9de5-db082e9a93f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:36.119324 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9fad0265-3f86-4cfe-9de5-db082e9a93f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:36.127028 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9fad0265-3f86-4cfe-9de5-db082e9a93f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:36.127476 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9fad0265-3f86-4cfe-9de5-db082e9a93f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:36.128252 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9fad0265-3f86-4cfe-9de5-db082e9a93f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:36.128687 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9fad0265-3f86-4cfe-9de5-db082e9a93f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:36.280866 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9fad0265-3f86-4cfe-9de5-db082e9a93f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:36.289064 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9fad0265-3f86-4cfe-9de5-db082e9a93f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1366 microversion: 2.1 time: 0.174661 Jul 26 17:15:36.289663 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 190/353] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:36 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:36.719666 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f11d7686-8636-4391-bdf2-813f50a4d9c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:36.720307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f11d7686-8636-4391-bdf2-813f50a4d9c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:36.726737 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f11d7686-8636-4391-bdf2-813f50a4d9c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:36.727183 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f11d7686-8636-4391-bdf2-813f50a4d9c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:36.727950 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f11d7686-8636-4391-bdf2-813f50a4d9c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:36.728377 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f11d7686-8636-4391-bdf2-813f50a4d9c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:36.894765 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f11d7686-8636-4391-bdf2-813f50a4d9c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:36.903647 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f11d7686-8636-4391-bdf2-813f50a4d9c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:36.905270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f11d7686-8636-4391-bdf2-813f50a4d9c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:36.906479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f11d7686-8636-4391-bdf2-813f50a4d9c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.191566 Jul 26 17:15:36.907056 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 191/354] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:36 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:36.951796 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-753f65c2-a1d1-46f0-a47a-c47a27c2ddca tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:36.965704 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-753f65c2-a1d1-46f0-a47a-c47a27c2ddca tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:36.976423 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-753f65c2-a1d1-46f0-a47a-c47a27c2ddca tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:36.977341 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-753f65c2-a1d1-46f0-a47a-c47a27c2ddca tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:36.978499 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-753f65c2-a1d1-46f0-a47a-c47a27c2ddca tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:36.979234 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-753f65c2-a1d1-46f0-a47a-c47a27c2ddca tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:37.212359 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-753f65c2-a1d1-46f0-a47a-c47a27c2ddca tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:37.226628 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-753f65c2-a1d1-46f0-a47a-c47a27c2ddca tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1723 microversion: 2.1 time: 0.284698 Jul 26 17:15:37.227335 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 192/355] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:36 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:37.310879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6499fadb-8fa8-4ad1-b5b4-0b05c0765ff2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:37.311479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6499fadb-8fa8-4ad1-b5b4-0b05c0765ff2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:37.317687 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6499fadb-8fa8-4ad1-b5b4-0b05c0765ff2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:37.318135 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6499fadb-8fa8-4ad1-b5b4-0b05c0765ff2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:37.318906 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6499fadb-8fa8-4ad1-b5b4-0b05c0765ff2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:37.319330 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6499fadb-8fa8-4ad1-b5b4-0b05c0765ff2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:37.482825 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6499fadb-8fa8-4ad1-b5b4-0b05c0765ff2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:37.485326 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:37.492768 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6499fadb-8fa8-4ad1-b5b4-0b05c0765ff2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1366 microversion: 2.1 time: 0.185884 Jul 26 17:15:37.493407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 193/356] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:37 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:37.938599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-df7bc2aa-a121-4d0f-98a1-767ba8686509 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:37.939510 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-df7bc2aa-a121-4d0f-98a1-767ba8686509 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:37.947017 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df7bc2aa-a121-4d0f-98a1-767ba8686509 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:37.947462 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df7bc2aa-a121-4d0f-98a1-767ba8686509 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:37.948291 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df7bc2aa-a121-4d0f-98a1-767ba8686509 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:37.948737 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df7bc2aa-a121-4d0f-98a1-767ba8686509 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:38.208106 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-df7bc2aa-a121-4d0f-98a1-767ba8686509 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:38.217747 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-df7bc2aa-a121-4d0f-98a1-767ba8686509 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:38.220474 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-df7bc2aa-a121-4d0f-98a1-767ba8686509 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:38.222093 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-df7bc2aa-a121-4d0f-98a1-767ba8686509 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.288082 Jul 26 17:15:38.222901 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 194/357] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:37 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:38.251831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-273d8b53-255c-4edb-b8d5-2734d60bed88 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:38.252704 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-273d8b53-255c-4edb-b8d5-2734d60bed88 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:38.261102 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-273d8b53-255c-4edb-b8d5-2734d60bed88 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:38.261743 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-273d8b53-255c-4edb-b8d5-2734d60bed88 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:38.263109 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-273d8b53-255c-4edb-b8d5-2734d60bed88 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:38.263476 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-273d8b53-255c-4edb-b8d5-2734d60bed88 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:38.484430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-273d8b53-255c-4edb-b8d5-2734d60bed88 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:38.500541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-273d8b53-255c-4edb-b8d5-2734d60bed88 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1723 microversion: 2.1 time: 0.254056 Jul 26 17:15:38.517554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 195/358] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:38 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:38.525661 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae89d350-c7f0-43a7-8195-57d50178d6e3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:38.526279 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ae89d350-c7f0-43a7-8195-57d50178d6e3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:38.534374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae89d350-c7f0-43a7-8195-57d50178d6e3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:38.534826 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae89d350-c7f0-43a7-8195-57d50178d6e3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:38.535615 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae89d350-c7f0-43a7-8195-57d50178d6e3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:38.536055 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae89d350-c7f0-43a7-8195-57d50178d6e3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:38.828630 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae89d350-c7f0-43a7-8195-57d50178d6e3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:38.838432 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ae89d350-c7f0-43a7-8195-57d50178d6e3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1366 microversion: 2.1 time: 0.316489 Jul 26 17:15:38.839090 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 196/359] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:38 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:39.260253 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dcffab6f-feeb-4c07-aac1-a762bbba0566 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:39.261225 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dcffab6f-feeb-4c07-aac1-a762bbba0566 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:39.268400 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcffab6f-feeb-4c07-aac1-a762bbba0566 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:39.268988 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcffab6f-feeb-4c07-aac1-a762bbba0566 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:39.269915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcffab6f-feeb-4c07-aac1-a762bbba0566 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:39.270350 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcffab6f-feeb-4c07-aac1-a762bbba0566 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:39.470794 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dcffab6f-feeb-4c07-aac1-a762bbba0566 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:39.486624 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dcffab6f-feeb-4c07-aac1-a762bbba0566 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:39.489715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dcffab6f-feeb-4c07-aac1-a762bbba0566 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:39.491618 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dcffab6f-feeb-4c07-aac1-a762bbba0566 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.235679 Jul 26 17:15:39.492376 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 197/360] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:39 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:39.527843 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-14c5d0b6-8982-4854-9133-8dc05add2750 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:39.529242 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-14c5d0b6-8982-4854-9133-8dc05add2750 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:39.536074 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14c5d0b6-8982-4854-9133-8dc05add2750 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:39.536596 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14c5d0b6-8982-4854-9133-8dc05add2750 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:39.537496 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14c5d0b6-8982-4854-9133-8dc05add2750 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:39.538001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14c5d0b6-8982-4854-9133-8dc05add2750 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:39.732586 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-14c5d0b6-8982-4854-9133-8dc05add2750 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:39.742694 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-14c5d0b6-8982-4854-9133-8dc05add2750 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1723 microversion: 2.1 time: 0.218777 Jul 26 17:15:39.743298 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 198/361] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:39 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:39.817851 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=43 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:39.864308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c21bb491-f196-4b57-8d9b-18533e4c44aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:39.865205 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c21bb491-f196-4b57-8d9b-18533e4c44aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:39.873303 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c21bb491-f196-4b57-8d9b-18533e4c44aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:39.874171 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c21bb491-f196-4b57-8d9b-18533e4c44aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:39.875073 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c21bb491-f196-4b57-8d9b-18533e4c44aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:39.875631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c21bb491-f196-4b57-8d9b-18533e4c44aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:40.135526 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c21bb491-f196-4b57-8d9b-18533e4c44aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:40.154874 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c21bb491-f196-4b57-8d9b-18533e4c44aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1366 microversion: 2.1 time: 0.293840 Jul 26 17:15:40.156665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 199/362] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:39 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:40.519900 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-00f939e4-2e88-4f33-8cfd-2497e7d39d2a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:40.521725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-00f939e4-2e88-4f33-8cfd-2497e7d39d2a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:40.532461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-00f939e4-2e88-4f33-8cfd-2497e7d39d2a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:40.532792 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-00f939e4-2e88-4f33-8cfd-2497e7d39d2a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:40.533624 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-00f939e4-2e88-4f33-8cfd-2497e7d39d2a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:40.534117 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-00f939e4-2e88-4f33-8cfd-2497e7d39d2a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:40.723111 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-00f939e4-2e88-4f33-8cfd-2497e7d39d2a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:40.734007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-00f939e4-2e88-4f33-8cfd-2497e7d39d2a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:40.737469 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-00f939e4-2e88-4f33-8cfd-2497e7d39d2a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:40.739088 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-00f939e4-2e88-4f33-8cfd-2497e7d39d2a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.226718 Jul 26 17:15:40.739667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 200/363] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:40 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:40.765345 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0f448306-1e72-4c01-b0bd-5d3f823b601a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:40.765951 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0f448306-1e72-4c01-b0bd-5d3f823b601a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:40.772158 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f448306-1e72-4c01-b0bd-5d3f823b601a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:40.772600 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f448306-1e72-4c01-b0bd-5d3f823b601a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:40.773408 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f448306-1e72-4c01-b0bd-5d3f823b601a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:40.773837 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f448306-1e72-4c01-b0bd-5d3f823b601a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:40.949579 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0f448306-1e72-4c01-b0bd-5d3f823b601a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:40.961718 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:40.963860 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0f448306-1e72-4c01-b0bd-5d3f823b601a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1723 microversion: 2.1 time: 0.202050 Jul 26 17:15:40.978402 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 201/364] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:40 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:41.192948 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c9c8ff94-4309-4332-a1b0-7457eaf3668d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:41.193653 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c9c8ff94-4309-4332-a1b0-7457eaf3668d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:41.205608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9c8ff94-4309-4332-a1b0-7457eaf3668d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:41.206478 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9c8ff94-4309-4332-a1b0-7457eaf3668d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:41.207868 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9c8ff94-4309-4332-a1b0-7457eaf3668d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:41.208609 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9c8ff94-4309-4332-a1b0-7457eaf3668d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:41.437670 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c9c8ff94-4309-4332-a1b0-7457eaf3668d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:41.448540 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c9c8ff94-4309-4332-a1b0-7457eaf3668d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1366 microversion: 2.1 time: 0.259542 Jul 26 17:15:41.449134 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 202/365] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:41 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:41.784482 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a87f3794-2d34-4c15-888f-a267d50dbdb7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:41.786702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a87f3794-2d34-4c15-888f-a267d50dbdb7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:41.801557 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a87f3794-2d34-4c15-888f-a267d50dbdb7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:41.802677 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a87f3794-2d34-4c15-888f-a267d50dbdb7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:41.804573 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a87f3794-2d34-4c15-888f-a267d50dbdb7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:41.806206 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a87f3794-2d34-4c15-888f-a267d50dbdb7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:41.978687 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a87f3794-2d34-4c15-888f-a267d50dbdb7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:41.987581 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a87f3794-2d34-4c15-888f-a267d50dbdb7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:41.989136 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a87f3794-2d34-4c15-888f-a267d50dbdb7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:41.990306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a87f3794-2d34-4c15-888f-a267d50dbdb7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.229669 Jul 26 17:15:41.990866 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 203/366] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:41 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:41.998290 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-922bce32-d001-4c39-8923-6b465abf95aa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:41.999049 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-922bce32-d001-4c39-8923-6b465abf95aa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:42.005250 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-922bce32-d001-4c39-8923-6b465abf95aa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:42.005694 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-922bce32-d001-4c39-8923-6b465abf95aa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:42.006466 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-922bce32-d001-4c39-8923-6b465abf95aa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:42.006900 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-922bce32-d001-4c39-8923-6b465abf95aa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:42.195539 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-922bce32-d001-4c39-8923-6b465abf95aa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:42.209953 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-922bce32-d001-4c39-8923-6b465abf95aa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1723 microversion: 2.1 time: 0.215369 Jul 26 17:15:42.210918 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 204/367] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:41 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:42.474899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6a479706-f813-4a33-8386-984a5a4c06a1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:42.475534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6a479706-f813-4a33-8386-984a5a4c06a1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:42.483843 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a479706-f813-4a33-8386-984a5a4c06a1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:42.484614 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a479706-f813-4a33-8386-984a5a4c06a1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:42.485761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a479706-f813-4a33-8386-984a5a4c06a1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:42.486393 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a479706-f813-4a33-8386-984a5a4c06a1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:42.698827 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a479706-f813-4a33-8386-984a5a4c06a1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:42.711711 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6a479706-f813-4a33-8386-984a5a4c06a1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1556 microversion: 2.1 time: 0.240660 Jul 26 17:15:42.712552 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 205/368] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:42 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1556 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:42.747393 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6da8ba0a-aab0-404d-81ed-3dbc200d0e4e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:42.749142 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6da8ba0a-aab0-404d-81ed-3dbc200d0e4e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:42.758760 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6da8ba0a-aab0-404d-81ed-3dbc200d0e4e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:42.759501 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6da8ba0a-aab0-404d-81ed-3dbc200d0e4e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:42.760639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6da8ba0a-aab0-404d-81ed-3dbc200d0e4e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:42.761329 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6da8ba0a-aab0-404d-81ed-3dbc200d0e4e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:42.883889 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6da8ba0a-aab0-404d-81ed-3dbc200d0e4e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142481 Jul 26 17:15:42.894753 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 206/369] 10.222.0.48 () {58 vars in 1275 bytes} [Tue Jul 26 17:15:42 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:15:43.021054 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2aff003c-44c6-4f0f-99ad-c79f57b2b327 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:43.024549 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2aff003c-44c6-4f0f-99ad-c79f57b2b327 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:43.055022 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2aff003c-44c6-4f0f-99ad-c79f57b2b327 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:43.056550 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2aff003c-44c6-4f0f-99ad-c79f57b2b327 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:43.058391 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2aff003c-44c6-4f0f-99ad-c79f57b2b327 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:43.059316 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2aff003c-44c6-4f0f-99ad-c79f57b2b327 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:43.586178 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2aff003c-44c6-4f0f-99ad-c79f57b2b327 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:43.614862 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2aff003c-44c6-4f0f-99ad-c79f57b2b327 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:43.616690 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2aff003c-44c6-4f0f-99ad-c79f57b2b327 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:43.618063 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2aff003c-44c6-4f0f-99ad-c79f57b2b327 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.606199 Jul 26 17:15:43.626416 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 207/370] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:43 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:43.632133 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0e2f5979-d0d4-4d99-954e-8982f252226a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:43.632751 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0e2f5979-d0d4-4d99-954e-8982f252226a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:43.668648 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e2f5979-d0d4-4d99-954e-8982f252226a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:43.669889 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e2f5979-d0d4-4d99-954e-8982f252226a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:43.679814 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e2f5979-d0d4-4d99-954e-8982f252226a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:43.680645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e2f5979-d0d4-4d99-954e-8982f252226a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:44.301228 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0e2f5979-d0d4-4d99-954e-8982f252226a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:44.309723 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0e2f5979-d0d4-4d99-954e-8982f252226a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1723 microversion: 2.1 time: 0.681854 Jul 26 17:15:44.315013 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 208/371] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:43 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1723 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:44.665743 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5be64039-1791-4b4f-9fb9-13b71c788b6e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:44.667167 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5be64039-1791-4b4f-9fb9-13b71c788b6e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:44.679395 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5be64039-1791-4b4f-9fb9-13b71c788b6e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:44.680555 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5be64039-1791-4b4f-9fb9-13b71c788b6e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:44.682324 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5be64039-1791-4b4f-9fb9-13b71c788b6e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:44.683392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5be64039-1791-4b4f-9fb9-13b71c788b6e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:45.037621 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5be64039-1791-4b4f-9fb9-13b71c788b6e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:45.050824 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5be64039-1791-4b4f-9fb9-13b71c788b6e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:45.054357 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5be64039-1791-4b4f-9fb9-13b71c788b6e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:45.055631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5be64039-1791-4b4f-9fb9-13b71c788b6e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.408954 Jul 26 17:15:45.060490 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 209/372] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:44 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:45.338635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-51afe6d2-3b24-49f4-adfa-e3160257e89c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:45.339546 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-51afe6d2-3b24-49f4-adfa-e3160257e89c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:45.346411 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51afe6d2-3b24-49f4-adfa-e3160257e89c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:45.346883 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51afe6d2-3b24-49f4-adfa-e3160257e89c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:45.347909 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51afe6d2-3b24-49f4-adfa-e3160257e89c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:45.348496 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51afe6d2-3b24-49f4-adfa-e3160257e89c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:45.676448 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-51afe6d2-3b24-49f4-adfa-e3160257e89c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:45.676448 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:45.687771 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-51afe6d2-3b24-49f4-adfa-e3160257e89c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1723 microversion: 2.1 time: 0.353031 Jul 26 17:15:45.688859 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 210/373] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:45 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:45.693752 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-8f47422c-1ff0-41f8-bc30-47ade8662ad4 req-1567f362-f44e-4e9a-a305-793bcca33a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db19722e-e060-4323-8b57-179687e601d6", "tag": "b046591b-0a3b-41bc-908a-5b12dbcf6b04"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:45.705008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-8f47422c-1ff0-41f8-bc30-47ade8662ad4 req-1567f362-f44e-4e9a-a305-793bcca33a61 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:45.705485 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-8f47422c-1ff0-41f8-bc30-47ade8662ad4 req-1567f362-f44e-4e9a-a305-793bcca33a61 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:45.719423 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-8f47422c-1ff0-41f8-bc30-47ade8662ad4 req-1567f362-f44e-4e9a-a305-793bcca33a61 service nova] Creating event network-changed:b046591b-0a3b-41bc-908a-5b12dbcf6b04 for instance db19722e-e060-4323-8b57-179687e601d6 on hv-cinder-83538 Jul 26 17:15:45.725776 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-8f47422c-1ff0-41f8-bc30-47ade8662ad4 req-1567f362-f44e-4e9a-a305-793bcca33a61 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035426 Jul 26 17:15:45.730889 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 211/374] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:15:46.103206 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-171743ff-f4d6-432a-9a83-60d49c23e219 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:46.104837 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-171743ff-f4d6-432a-9a83-60d49c23e219 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:46.118947 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-171743ff-f4d6-432a-9a83-60d49c23e219 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:46.120293 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-171743ff-f4d6-432a-9a83-60d49c23e219 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:46.122947 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-171743ff-f4d6-432a-9a83-60d49c23e219 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:46.124151 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-171743ff-f4d6-432a-9a83-60d49c23e219 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:46.446987 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-171743ff-f4d6-432a-9a83-60d49c23e219 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:46.462283 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-171743ff-f4d6-432a-9a83-60d49c23e219 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:46.464500 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-171743ff-f4d6-432a-9a83-60d49c23e219 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:46.466304 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-171743ff-f4d6-432a-9a83-60d49c23e219 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.371522 Jul 26 17:15:46.506790 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 212/375] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:46 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:46.741891 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-eb9264da-c499-42d1-b824-71cc0f956469 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:46.742608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-eb9264da-c499-42d1-b824-71cc0f956469 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:46.757567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb9264da-c499-42d1-b824-71cc0f956469 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:46.762175 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb9264da-c499-42d1-b824-71cc0f956469 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:46.765711 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb9264da-c499-42d1-b824-71cc0f956469 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:46.767418 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb9264da-c499-42d1-b824-71cc0f956469 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:47.048478 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-eb9264da-c499-42d1-b824-71cc0f956469 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:47.061190 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-eb9264da-c499-42d1-b824-71cc0f956469 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1723 microversion: 2.1 time: 0.331167 Jul 26 17:15:47.062219 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 213/376] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:46 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:47.513453 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-17cc8a59-aa2d-465f-9bfe-aac221361302 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:47.516842 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-17cc8a59-aa2d-465f-9bfe-aac221361302 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:47.524845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-17cc8a59-aa2d-465f-9bfe-aac221361302 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:47.525372 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-17cc8a59-aa2d-465f-9bfe-aac221361302 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:47.526171 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-17cc8a59-aa2d-465f-9bfe-aac221361302 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:47.526611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-17cc8a59-aa2d-465f-9bfe-aac221361302 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:47.832322 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-17cc8a59-aa2d-465f-9bfe-aac221361302 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:47.848624 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-17cc8a59-aa2d-465f-9bfe-aac221361302 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:47.851843 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-17cc8a59-aa2d-465f-9bfe-aac221361302 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:47.854478 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-17cc8a59-aa2d-465f-9bfe-aac221361302 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.346115 Jul 26 17:15:47.856826 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 214/377] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:47 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:48.098373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-05f89280-e241-448b-8c34-cf078556bccf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:48.109845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-05f89280-e241-448b-8c34-cf078556bccf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:48.141220 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05f89280-e241-448b-8c34-cf078556bccf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:48.148406 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05f89280-e241-448b-8c34-cf078556bccf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:48.149313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05f89280-e241-448b-8c34-cf078556bccf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:48.149770 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05f89280-e241-448b-8c34-cf078556bccf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:48.412123 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-05f89280-e241-448b-8c34-cf078556bccf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:48.438370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-05f89280-e241-448b-8c34-cf078556bccf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1723 microversion: 2.1 time: 0.350158 Jul 26 17:15:48.439965 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 215/378] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:48 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:48.899313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e0258857-5788-46f0-b435-c5b75b79dd76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:48.901402 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e0258857-5788-46f0-b435-c5b75b79dd76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:48.919840 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0258857-5788-46f0-b435-c5b75b79dd76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:48.921259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0258857-5788-46f0-b435-c5b75b79dd76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:48.922979 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0258857-5788-46f0-b435-c5b75b79dd76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:48.924303 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0258857-5788-46f0-b435-c5b75b79dd76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:49.309107 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e0258857-5788-46f0-b435-c5b75b79dd76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:49.320779 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e0258857-5788-46f0-b435-c5b75b79dd76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:49.323116 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e0258857-5788-46f0-b435-c5b75b79dd76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:49.324385 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e0258857-5788-46f0-b435-c5b75b79dd76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.432168 Jul 26 17:15:49.325006 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 216/379] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:48 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:49.476175 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1b2ee77f-4c07-4e4f-86fe-9a1e8a43d3fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:49.476765 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1b2ee77f-4c07-4e4f-86fe-9a1e8a43d3fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:49.489411 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b2ee77f-4c07-4e4f-86fe-9a1e8a43d3fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:49.491838 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b2ee77f-4c07-4e4f-86fe-9a1e8a43d3fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:49.495648 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b2ee77f-4c07-4e4f-86fe-9a1e8a43d3fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:49.497631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b2ee77f-4c07-4e4f-86fe-9a1e8a43d3fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:49.737865 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1b2ee77f-4c07-4e4f-86fe-9a1e8a43d3fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:49.753675 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1b2ee77f-4c07-4e4f-86fe-9a1e8a43d3fa tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1723 microversion: 2.1 time: 0.281548 Jul 26 17:15:49.754502 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 217/380] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:49 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:50.354680 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a89e13eb-16d0-4305-8dcd-8a4aa855c539 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:50.355931 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a89e13eb-16d0-4305-8dcd-8a4aa855c539 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:50.372990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a89e13eb-16d0-4305-8dcd-8a4aa855c539 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:50.374309 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a89e13eb-16d0-4305-8dcd-8a4aa855c539 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:50.379421 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a89e13eb-16d0-4305-8dcd-8a4aa855c539 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:50.381351 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a89e13eb-16d0-4305-8dcd-8a4aa855c539 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:50.735946 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a89e13eb-16d0-4305-8dcd-8a4aa855c539 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:50.752138 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a89e13eb-16d0-4305-8dcd-8a4aa855c539 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:50.756813 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a89e13eb-16d0-4305-8dcd-8a4aa855c539 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:50.758886 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a89e13eb-16d0-4305-8dcd-8a4aa855c539 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.412573 Jul 26 17:15:50.760177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 218/381] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:50 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:50.788406 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e4edbacd-1e37-4bc0-9c51-a5f344cdbe9c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:50.789197 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e4edbacd-1e37-4bc0-9c51-a5f344cdbe9c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:50.803071 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4edbacd-1e37-4bc0-9c51-a5f344cdbe9c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:50.803997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4edbacd-1e37-4bc0-9c51-a5f344cdbe9c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:50.804372 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4edbacd-1e37-4bc0-9c51-a5f344cdbe9c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:50.804813 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4edbacd-1e37-4bc0-9c51-a5f344cdbe9c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:51.146680 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e4edbacd-1e37-4bc0-9c51-a5f344cdbe9c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:51.155756 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e4edbacd-1e37-4bc0-9c51-a5f344cdbe9c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1723 microversion: 2.1 time: 0.373850 Jul 26 17:15:51.156575 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 219/382] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:50 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:51.791578 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c72f8e18-4995-4a7c-b90d-17f6160cb737 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:51.794925 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c72f8e18-4995-4a7c-b90d-17f6160cb737 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:51.818996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c72f8e18-4995-4a7c-b90d-17f6160cb737 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:51.818996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c72f8e18-4995-4a7c-b90d-17f6160cb737 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:51.818996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c72f8e18-4995-4a7c-b90d-17f6160cb737 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:51.818996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c72f8e18-4995-4a7c-b90d-17f6160cb737 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:52.080557 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c72f8e18-4995-4a7c-b90d-17f6160cb737 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:52.098969 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c72f8e18-4995-4a7c-b90d-17f6160cb737 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:52.100808 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c72f8e18-4995-4a7c-b90d-17f6160cb737 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:52.102361 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c72f8e18-4995-4a7c-b90d-17f6160cb737 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.318645 Jul 26 17:15:52.103365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 220/383] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:51 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:52.186600 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2cfc5676-6ea3-41eb-b21c-86c739209a63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:52.187631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2cfc5676-6ea3-41eb-b21c-86c739209a63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:52.199587 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2cfc5676-6ea3-41eb-b21c-86c739209a63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:52.201247 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2cfc5676-6ea3-41eb-b21c-86c739209a63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:52.202271 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2cfc5676-6ea3-41eb-b21c-86c739209a63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:52.203110 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2cfc5676-6ea3-41eb-b21c-86c739209a63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:52.490522 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2cfc5676-6ea3-41eb-b21c-86c739209a63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:52.506211 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2cfc5676-6ea3-41eb-b21c-86c739209a63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1700 microversion: 2.1 time: 0.328037 Jul 26 17:15:52.507466 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 221/384] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:52 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1700 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:52.553398 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b7ce0899-9b71-4563-a01f-03481e105a7a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:15:52.580444 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.network.neutron [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] validate_networks() for [('0af083cb-d1e4-488d-8d25-6adac66e506d', None, None, None, None, None)] {{(pid=118122) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:15:52.591665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7ce0899-9b71-4563-a01f-03481e105a7a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:52.592869 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7ce0899-9b71-4563-a01f-03481e105a7a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:52.668508 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b7ce0899-9b71-4563-a01f-03481e105a7a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Going to try to start instance {{(pid=118121) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 17:15:52.753606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b7ce0899-9b71-4563-a01f-03481e105a7a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "POST /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/action" status: 202 len: 0 microversion: 2.1 time: 0.204312 Jul 26 17:15:52.754669 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 222/385] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:15:52 2022] POST /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:15:52.787726 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9f25b243-f996-4527-b8af-9c8fad30c16d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:52.789535 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9f25b243-f996-4527-b8af-9c8fad30c16d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:52.808928 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f25b243-f996-4527-b8af-9c8fad30c16d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:52.810551 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f25b243-f996-4527-b8af-9c8fad30c16d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:52.815705 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f25b243-f996-4527-b8af-9c8fad30c16d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:52.816505 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f25b243-f996-4527-b8af-9c8fad30c16d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:53.392683 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9f25b243-f996-4527-b8af-9c8fad30c16d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:53.410225 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9f25b243-f996-4527-b8af-9c8fad30c16d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1709 microversion: 2.1 time: 0.648376 Jul 26 17:15:53.411288 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 223/386] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:52 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1709 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:53.435114 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b57cec06-cf20-4715-8f8a-4c3ebecfbe34 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:53.436650 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b57cec06-cf20-4715-8f8a-4c3ebecfbe34 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:53.445849 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:53.449179 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b57cec06-cf20-4715-8f8a-4c3ebecfbe34 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:53.451559 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b57cec06-cf20-4715-8f8a-4c3ebecfbe34 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:53.452903 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b57cec06-cf20-4715-8f8a-4c3ebecfbe34 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:53.453575 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b57cec06-cf20-4715-8f8a-4c3ebecfbe34 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:53.644395 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b57cec06-cf20-4715-8f8a-4c3ebecfbe34 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:53.655903 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b57cec06-cf20-4715-8f8a-4c3ebecfbe34 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:53.658502 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b57cec06-cf20-4715-8f8a-4c3ebecfbe34 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:53.660469 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b57cec06-cf20-4715-8f8a-4c3ebecfbe34 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.233799 Jul 26 17:15:53.661476 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 224/387] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:53 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:54.064304 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Flavor limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:15:54.064929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Image limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:15:54.065401 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Flavor pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:15:54.066293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Image pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:15:54.066969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:15:54.092358 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:54.093187 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:54.094319 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:54.094954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:54.146356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Getting quotas for project 2b8b6c88af94417c840fdafd1fe431b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:15:54.167554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Getting quotas for user 97115d07acc5464bb7b097039471fee6 and project 2b8b6c88af94417c840fdafd1fe431b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:15:54.197759 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Going to run 1 instances... {{(pid=118122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:15:54.211477 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:15:54.363340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-692a515a-d0bc-4f60-bfe5-fe0f27738977 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 23.426193 Jul 26 17:15:54.365214 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 164/388] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:15:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 23429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 17:15:54.375826 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-df6aaefa-04f5-428e-a478-d5ad690349f2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:54.376448 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-df6aaefa-04f5-428e-a478-d5ad690349f2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:54.448188 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-29e77591-d74d-48d2-b7e8-1640bf013753 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:54.449437 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-29e77591-d74d-48d2-b7e8-1640bf013753 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:54.516413 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-29e77591-d74d-48d2-b7e8-1640bf013753 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:54.518347 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-29e77591-d74d-48d2-b7e8-1640bf013753 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:54.523649 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-29e77591-d74d-48d2-b7e8-1640bf013753 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:54.524768 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-29e77591-d74d-48d2-b7e8-1640bf013753 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:54.571532 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-df6aaefa-04f5-428e-a478-d5ad690349f2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:54.582849 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-df6aaefa-04f5-428e-a478-d5ad690349f2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1246 microversion: 2.1 time: 0.210264 Jul 26 17:15:54.585295 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 225/389] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:54 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1246 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:54.692523 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a84210c9-1a0d-44d4-917b-005be094f414 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:54.693553 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a84210c9-1a0d-44d4-917b-005be094f414 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:54.707839 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a84210c9-1a0d-44d4-917b-005be094f414 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:54.708303 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a84210c9-1a0d-44d4-917b-005be094f414 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:54.711511 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a84210c9-1a0d-44d4-917b-005be094f414 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:54.713958 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a84210c9-1a0d-44d4-917b-005be094f414 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:55.384779 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-29e77591-d74d-48d2-b7e8-1640bf013753 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:55.477083 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-29e77591-d74d-48d2-b7e8-1640bf013753 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1709 microversion: 2.1 time: 1.041917 Jul 26 17:15:55.492233 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 165/390] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:54 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1709 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:15:55.527684 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a84210c9-1a0d-44d4-917b-005be094f414 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:55.560665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a84210c9-1a0d-44d4-917b-005be094f414 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:55.580167 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a84210c9-1a0d-44d4-917b-005be094f414 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:55.591601 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a84210c9-1a0d-44d4-917b-005be094f414 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.897314 Jul 26 17:15:55.612653 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3c2a392f-c441-4523-96ce-082b4cbbbd70 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:55.613640 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3c2a392f-c441-4523-96ce-082b4cbbbd70 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:55.633185 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 226/391] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:54 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:55.888169 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3c2a392f-c441-4523-96ce-082b4cbbbd70 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:55.914758 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3c2a392f-c441-4523-96ce-082b4cbbbd70 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1246 microversion: 2.1 time: 0.307122 Jul 26 17:15:55.932114 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 166/392] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:55 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1246 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:56.517944 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b7a0f996-3e78-4612-8f87-af593c9f5b35 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:56.518875 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b7a0f996-3e78-4612-8f87-af593c9f5b35 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:56.556362 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7a0f996-3e78-4612-8f87-af593c9f5b35 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:56.557784 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7a0f996-3e78-4612-8f87-af593c9f5b35 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:56.558855 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7a0f996-3e78-4612-8f87-af593c9f5b35 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:56.560608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7a0f996-3e78-4612-8f87-af593c9f5b35 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:56.641459 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-be2e42c8-6dc9-420a-9124-3314fed16bd6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:56.642212 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-be2e42c8-6dc9-420a-9124-3314fed16bd6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:56.666412 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-be2e42c8-6dc9-420a-9124-3314fed16bd6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:56.666880 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-be2e42c8-6dc9-420a-9124-3314fed16bd6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:56.667755 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-be2e42c8-6dc9-420a-9124-3314fed16bd6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:56.668585 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-be2e42c8-6dc9-420a-9124-3314fed16bd6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:56.965183 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b7a0f996-3e78-4612-8f87-af593c9f5b35 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:56.980542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b7a0f996-3e78-4612-8f87-af593c9f5b35 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1709 microversion: 2.1 time: 0.477367 Jul 26 17:15:56.994357 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 227/393] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:56 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1709 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:57.010768 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6236eda1-53a2-4f9c-8b32-d4f82df30381 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:57.014777 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6236eda1-53a2-4f9c-8b32-d4f82df30381 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:57.039576 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6236eda1-53a2-4f9c-8b32-d4f82df30381 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:57.047863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6236eda1-53a2-4f9c-8b32-d4f82df30381 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:57.048730 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6236eda1-53a2-4f9c-8b32-d4f82df30381 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:57.049228 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6236eda1-53a2-4f9c-8b32-d4f82df30381 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:57.057619 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:15:57.079084 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-be2e42c8-6dc9-420a-9124-3314fed16bd6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:57.105344 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-be2e42c8-6dc9-420a-9124-3314fed16bd6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:57.109967 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-be2e42c8-6dc9-420a-9124-3314fed16bd6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:57.114039 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-be2e42c8-6dc9-420a-9124-3314fed16bd6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.477934 Jul 26 17:15:57.120074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 167/394] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:56 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:57.167394 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6236eda1-53a2-4f9c-8b32-d4f82df30381 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:57.178235 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6236eda1-53a2-4f9c-8b32-d4f82df30381 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1242 microversion: 2.1 time: 0.182615 Jul 26 17:15:57.179388 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 228/395] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:56 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1242 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:58.024629 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6cb870de-02ca-4f77-b59d-4b810b7b54fb tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:58.032133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6cb870de-02ca-4f77-b59d-4b810b7b54fb tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:58.078862 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6cb870de-02ca-4f77-b59d-4b810b7b54fb tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:58.085777 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6cb870de-02ca-4f77-b59d-4b810b7b54fb tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:58.089648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6cb870de-02ca-4f77-b59d-4b810b7b54fb tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:58.101540 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6cb870de-02ca-4f77-b59d-4b810b7b54fb tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:58.148673 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e6d1b64e-d0e7-4804-865c-3b8315bd3cef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:58.157259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e6d1b64e-d0e7-4804-865c-3b8315bd3cef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:58.171602 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6d1b64e-d0e7-4804-865c-3b8315bd3cef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:58.191042 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6d1b64e-d0e7-4804-865c-3b8315bd3cef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:58.191951 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6d1b64e-d0e7-4804-865c-3b8315bd3cef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:58.192427 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6d1b64e-d0e7-4804-865c-3b8315bd3cef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:58.620516 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6d1b64e-d0e7-4804-865c-3b8315bd3cef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:58.641682 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6d1b64e-d0e7-4804-865c-3b8315bd3cef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:58.646461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6d1b64e-d0e7-4804-865c-3b8315bd3cef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:58.651666 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e6d1b64e-d0e7-4804-865c-3b8315bd3cef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.507999 Jul 26 17:15:58.652933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 229/396] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:58 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:15:58.668409 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0c5a1aca-e679-4789-a57d-b78f9c121c70 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:58.676435 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0c5a1aca-e679-4789-a57d-b78f9c121c70 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:58.691586 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c5a1aca-e679-4789-a57d-b78f9c121c70 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:58.692513 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c5a1aca-e679-4789-a57d-b78f9c121c70 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:58.695087 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c5a1aca-e679-4789-a57d-b78f9c121c70 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:58.696834 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c5a1aca-e679-4789-a57d-b78f9c121c70 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:58.908283 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c5a1aca-e679-4789-a57d-b78f9c121c70 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:58.928030 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0c5a1aca-e679-4789-a57d-b78f9c121c70 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1304 microversion: 2.1 time: 0.271854 Jul 26 17:15:58.933192 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 230/397] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:58 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1304 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:59.177103 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6cb870de-02ca-4f77-b59d-4b810b7b54fb tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:59.192649 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6cb870de-02ca-4f77-b59d-4b810b7b54fb tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1713 microversion: 2.1 time: 1.176888 Jul 26 17:15:59.211715 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 168/398] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:58 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1713 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:15:59.682993 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-03af0643-f3fc-462b-9bf3-59c79c4ee63c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:59.685658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-03af0643-f3fc-462b-9bf3-59c79c4ee63c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:59.694594 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03af0643-f3fc-462b-9bf3-59c79c4ee63c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:59.696353 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03af0643-f3fc-462b-9bf3-59c79c4ee63c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:59.697484 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03af0643-f3fc-462b-9bf3-59c79c4ee63c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:59.703432 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03af0643-f3fc-462b-9bf3-59c79c4ee63c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:59.936714 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-03af0643-f3fc-462b-9bf3-59c79c4ee63c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:59.947290 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-03af0643-f3fc-462b-9bf3-59c79c4ee63c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:59.949503 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-03af0643-f3fc-462b-9bf3-59c79c4ee63c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:15:59.950869 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-03af0643-f3fc-462b-9bf3-59c79c4ee63c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.272779 Jul 26 17:15:59.951725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 231/399] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:15:59 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:15:59.972579 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-10902e99-127b-4c46-9201-e4b38b73ecf7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:15:59.976473 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-10902e99-127b-4c46-9201-e4b38b73ecf7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:15:59.995501 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-10902e99-127b-4c46-9201-e4b38b73ecf7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:59.996242 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-10902e99-127b-4c46-9201-e4b38b73ecf7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:15:59.999096 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-10902e99-127b-4c46-9201-e4b38b73ecf7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:15:59.999910 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-10902e99-127b-4c46-9201-e4b38b73ecf7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:00.287869 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-10902e99-127b-4c46-9201-e4b38b73ecf7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:00.320792 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-10902e99-127b-4c46-9201-e4b38b73ecf7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.362320 Jul 26 17:16:00.337014 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 169/400] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:15:59 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:00.980258 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ba11f82-1c76-4797-b311-76a061296fe1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:00.981548 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ba11f82-1c76-4797-b311-76a061296fe1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:01.015962 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ba11f82-1c76-4797-b311-76a061296fe1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:01.016782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ba11f82-1c76-4797-b311-76a061296fe1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:01.018246 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ba11f82-1c76-4797-b311-76a061296fe1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:01.019067 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ba11f82-1c76-4797-b311-76a061296fe1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:01.279003 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ba11f82-1c76-4797-b311-76a061296fe1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:01.292654 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ba11f82-1c76-4797-b311-76a061296fe1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:01.295884 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ba11f82-1c76-4797-b311-76a061296fe1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:01.297810 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ba11f82-1c76-4797-b311-76a061296fe1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.325182 Jul 26 17:16:01.298880 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 232/401] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:00 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:01.323236 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-6c501988-e5d1-4d0f-bfb4-2f47a8b393ad req-32f6b971-f0bf-49ee-a95f-6fadc4e18ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7701e238-d4bd-4e91-9ae9-9a5845f8a1ce", "tag": "d2849b37-4de3-40c3-97ec-d1f87c72f88f"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:16:01.351400 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6637c7fb-2b8c-46c0-bed9-e150672e6472 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:01.351914 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6637c7fb-2b8c-46c0-bed9-e150672e6472 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:01.361408 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6637c7fb-2b8c-46c0-bed9-e150672e6472 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:01.361861 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6637c7fb-2b8c-46c0-bed9-e150672e6472 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:01.366636 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6637c7fb-2b8c-46c0-bed9-e150672e6472 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:01.374045 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6637c7fb-2b8c-46c0-bed9-e150672e6472 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:01.377145 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-6c501988-e5d1-4d0f-bfb4-2f47a8b393ad req-32f6b971-f0bf-49ee-a95f-6fadc4e18ee6 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:01.377747 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-6c501988-e5d1-4d0f-bfb4-2f47a8b393ad req-32f6b971-f0bf-49ee-a95f-6fadc4e18ee6 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:01.411245 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-6c501988-e5d1-4d0f-bfb4-2f47a8b393ad req-32f6b971-f0bf-49ee-a95f-6fadc4e18ee6 service nova] Creating event network-changed:d2849b37-4de3-40c3-97ec-d1f87c72f88f for instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce on hv-cinder-83538 Jul 26 17:16:01.418030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-6c501988-e5d1-4d0f-bfb4-2f47a8b393ad req-32f6b971-f0bf-49ee-a95f-6fadc4e18ee6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098888 Jul 26 17:16:01.419284 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 170/402] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:16:01.699782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6637c7fb-2b8c-46c0-bed9-e150672e6472 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:01.711017 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6637c7fb-2b8c-46c0-bed9-e150672e6472 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.364917 Jul 26 17:16:01.712373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 233/403] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:01 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:16:02.327058 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e45d809b-b510-4332-a6d0-49a63d0fb014 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:02.328654 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-e45d809b-b510-4332-a6d0-49a63d0fb014 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:02.341055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e45d809b-b510-4332-a6d0-49a63d0fb014 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:02.342242 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e45d809b-b510-4332-a6d0-49a63d0fb014 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:02.344129 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e45d809b-b510-4332-a6d0-49a63d0fb014 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:02.347320 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e45d809b-b510-4332-a6d0-49a63d0fb014 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:02.594113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e45d809b-b510-4332-a6d0-49a63d0fb014 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:02.604314 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e45d809b-b510-4332-a6d0-49a63d0fb014 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:02.607043 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e45d809b-b510-4332-a6d0-49a63d0fb014 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:02.608950 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e45d809b-b510-4332-a6d0-49a63d0fb014 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.288449 Jul 26 17:16:02.625864 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 171/404] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:02 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:02.733659 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c89e338c-4750-41ba-a160-9952689cc1e0 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:02.734441 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c89e338c-4750-41ba-a160-9952689cc1e0 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:02.742096 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c89e338c-4750-41ba-a160-9952689cc1e0 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:02.742568 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c89e338c-4750-41ba-a160-9952689cc1e0 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:02.744506 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c89e338c-4750-41ba-a160-9952689cc1e0 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:02.745054 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c89e338c-4750-41ba-a160-9952689cc1e0 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:02.977860 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c89e338c-4750-41ba-a160-9952689cc1e0 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:02.992444 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c89e338c-4750-41ba-a160-9952689cc1e0 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.262281 Jul 26 17:16:02.995732 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 234/405] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:02 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:03.640803 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-cbd82265-5e5f-4603-b299-1d26745d5f82 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:03.644564 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-cbd82265-5e5f-4603-b299-1d26745d5f82 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:03.659274 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cbd82265-5e5f-4603-b299-1d26745d5f82 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:03.660237 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cbd82265-5e5f-4603-b299-1d26745d5f82 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:03.661461 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cbd82265-5e5f-4603-b299-1d26745d5f82 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:03.662029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cbd82265-5e5f-4603-b299-1d26745d5f82 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:04.032215 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dcc13785-48e1-42c3-96a6-22e4134dc473 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:04.034152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dcc13785-48e1-42c3-96a6-22e4134dc473 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:04.046332 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcc13785-48e1-42c3-96a6-22e4134dc473 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:04.047451 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcc13785-48e1-42c3-96a6-22e4134dc473 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:04.048693 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcc13785-48e1-42c3-96a6-22e4134dc473 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:04.050714 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcc13785-48e1-42c3-96a6-22e4134dc473 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:04.054273 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-cbd82265-5e5f-4603-b299-1d26745d5f82 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:04.084576 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-cbd82265-5e5f-4603-b299-1d26745d5f82 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:04.089632 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-cbd82265-5e5f-4603-b299-1d26745d5f82 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:04.093128 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-cbd82265-5e5f-4603-b299-1d26745d5f82 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.458699 Jul 26 17:16:04.109819 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 172/406] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:03 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:04.440574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dcc13785-48e1-42c3-96a6-22e4134dc473 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:04.451146 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dcc13785-48e1-42c3-96a6-22e4134dc473 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.423400 Jul 26 17:16:04.458049 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 235/407] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:04 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:05.150256 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7d74bf08-b148-415f-8991-9d48e2802f93 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:05.152459 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7d74bf08-b148-415f-8991-9d48e2802f93 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:05.170898 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:16:05.177679 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7d74bf08-b148-415f-8991-9d48e2802f93 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:05.178550 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7d74bf08-b148-415f-8991-9d48e2802f93 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:05.180393 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7d74bf08-b148-415f-8991-9d48e2802f93 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:05.181548 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7d74bf08-b148-415f-8991-9d48e2802f93 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:05.485776 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c3a192d5-55e1-4f96-81c7-08661a0453b2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:05.489449 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c3a192d5-55e1-4f96-81c7-08661a0453b2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:05.498644 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:16:05.527252 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3a192d5-55e1-4f96-81c7-08661a0453b2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:05.530378 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3a192d5-55e1-4f96-81c7-08661a0453b2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:05.534371 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3a192d5-55e1-4f96-81c7-08661a0453b2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:05.535314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3a192d5-55e1-4f96-81c7-08661a0453b2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:05.538037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7d74bf08-b148-415f-8991-9d48e2802f93 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:05.552173 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7d74bf08-b148-415f-8991-9d48e2802f93 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:05.555384 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7d74bf08-b148-415f-8991-9d48e2802f93 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:05.557590 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7d74bf08-b148-415f-8991-9d48e2802f93 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.418268 Jul 26 17:16:05.572993 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 173/408] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:05 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:05.905053 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c3a192d5-55e1-4f96-81c7-08661a0453b2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:05.920555 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c3a192d5-55e1-4f96-81c7-08661a0453b2 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.445595 Jul 26 17:16:05.921608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 236/409] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:05 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:06.596164 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-237b7c22-e031-45af-b397-68bafbeae2e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:06.599260 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-237b7c22-e031-45af-b397-68bafbeae2e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:06.612284 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=8 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:16:06.618149 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-237b7c22-e031-45af-b397-68bafbeae2e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:06.619299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-237b7c22-e031-45af-b397-68bafbeae2e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:06.620552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-237b7c22-e031-45af-b397-68bafbeae2e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:06.621384 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-237b7c22-e031-45af-b397-68bafbeae2e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:06.971074 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-191ba7fb-4c3c-4641-8b12-7c35398e0217 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:06.974976 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-191ba7fb-4c3c-4641-8b12-7c35398e0217 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:06.983114 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-191ba7fb-4c3c-4641-8b12-7c35398e0217 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:06.984438 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-191ba7fb-4c3c-4641-8b12-7c35398e0217 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:06.987306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-191ba7fb-4c3c-4641-8b12-7c35398e0217 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:06.988563 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-191ba7fb-4c3c-4641-8b12-7c35398e0217 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:07.049062 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-237b7c22-e031-45af-b397-68bafbeae2e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:07.091320 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-237b7c22-e031-45af-b397-68bafbeae2e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:07.097405 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-237b7c22-e031-45af-b397-68bafbeae2e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:07.104129 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-237b7c22-e031-45af-b397-68bafbeae2e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.520251 Jul 26 17:16:07.106357 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 174/410] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:06 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:07.421379 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-191ba7fb-4c3c-4641-8b12-7c35398e0217 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:07.429857 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-191ba7fb-4c3c-4641-8b12-7c35398e0217 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.489910 Jul 26 17:16:07.430448 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 237/411] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:06 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:16:08.146823 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-994bf568-c9b5-45b2-b70b-94366f56469d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:08.149230 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-994bf568-c9b5-45b2-b70b-94366f56469d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:08.171147 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-994bf568-c9b5-45b2-b70b-94366f56469d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:08.171940 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-994bf568-c9b5-45b2-b70b-94366f56469d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:08.173475 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-994bf568-c9b5-45b2-b70b-94366f56469d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:08.174249 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-994bf568-c9b5-45b2-b70b-94366f56469d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:08.407893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9f02e809-e217-41df-88c7-8a3a719406fd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0289e8b-97ee-4dca-acfe-6e66d8d93883", "device": "/dev/sdb"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:16:08.413413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9f02e809-e217-41df-88c7-8a3a719406fd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:08.435472 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f02e809-e217-41df-88c7-8a3a719406fd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:08.437323 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f02e809-e217-41df-88c7-8a3a719406fd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:08.440763 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f02e809-e217-41df-88c7-8a3a719406fd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:08.441622 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f02e809-e217-41df-88c7-8a3a719406fd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:08.791252 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-994bf568-c9b5-45b2-b70b-94366f56469d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:08.817636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-994bf568-c9b5-45b2-b70b-94366f56469d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:08.820840 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-994bf568-c9b5-45b2-b70b-94366f56469d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:08.825486 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-994bf568-c9b5-45b2-b70b-94366f56469d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1741 microversion: 2.20 time: 0.693043 Jul 26 17:16:08.826644 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 175/412] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:08 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1741 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:08.849642 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-06eef7c3-a74f-41b2-a46b-af788a0a7cf5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:08.851785 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-06eef7c3-a74f-41b2-a46b-af788a0a7cf5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:08.865161 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-06eef7c3-a74f-41b2-a46b-af788a0a7cf5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:08.866839 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-06eef7c3-a74f-41b2-a46b-af788a0a7cf5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:08.869557 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-06eef7c3-a74f-41b2-a46b-af788a0a7cf5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:08.872259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-06eef7c3-a74f-41b2-a46b-af788a0a7cf5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:08.874093 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9f02e809-e217-41df-88c7-8a3a719406fd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "POST /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473374 Jul 26 17:16:08.877012 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 238/413] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:16:08 2022] POST /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc/os-volume_attachments => generated 194 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:16:09.275421 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-06eef7c3-a74f-41b2-a46b-af788a0a7cf5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:09.285700 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-06eef7c3-a74f-41b2-a46b-af788a0a7cf5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.456199 Jul 26 17:16:09.286506 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 176/414] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:08 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:09.873981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-260e020a-6776-4352-a889-991e6e87b798 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:09.874700 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-260e020a-6776-4352-a889-991e6e87b798 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:09.893269 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-260e020a-6776-4352-a889-991e6e87b798 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:09.893738 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-260e020a-6776-4352-a889-991e6e87b798 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:09.894556 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-260e020a-6776-4352-a889-991e6e87b798 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:09.895700 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-260e020a-6776-4352-a889-991e6e87b798 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:10.185013 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-260e020a-6776-4352-a889-991e6e87b798 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:10.194386 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-260e020a-6776-4352-a889-991e6e87b798 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:10.195968 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-260e020a-6776-4352-a889-991e6e87b798 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:10.197206 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-260e020a-6776-4352-a889-991e6e87b798 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1723 microversion: 2.20 time: 0.349447 Jul 26 17:16:10.198285 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 239/415] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:09 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:10.326778 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-61be80cb-ffc7-426b-82de-031a4256c024 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:10.328985 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-61be80cb-ffc7-426b-82de-031a4256c024 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:10.343995 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-61be80cb-ffc7-426b-82de-031a4256c024 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:10.347476 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-61be80cb-ffc7-426b-82de-031a4256c024 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:10.348823 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-61be80cb-ffc7-426b-82de-031a4256c024 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:10.352075 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-61be80cb-ffc7-426b-82de-031a4256c024 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:10.452670 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-d745d703-e760-4b69-a5f0-64eed4c263ea req-c6cc16eb-1eeb-4e74-b3ed-7c3d5394ddf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7701e238-d4bd-4e91-9ae9-9a5845f8a1ce", "name": "network-vif-plugged", "status": "completed", "tag": "d2849b37-4de3-40c3-97ec-d1f87c72f88f"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:16:10.474182 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-d745d703-e760-4b69-a5f0-64eed4c263ea req-c6cc16eb-1eeb-4e74-b3ed-7c3d5394ddf9 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:10.475504 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-d745d703-e760-4b69-a5f0-64eed4c263ea req-c6cc16eb-1eeb-4e74-b3ed-7c3d5394ddf9 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:10.510015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-d745d703-e760-4b69-a5f0-64eed4c263ea req-c6cc16eb-1eeb-4e74-b3ed-7c3d5394ddf9 service nova] Creating event network-vif-plugged:d2849b37-4de3-40c3-97ec-d1f87c72f88f for instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce on hv-cinder-83538 Jul 26 17:16:10.522161 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-d745d703-e760-4b69-a5f0-64eed4c263ea req-c6cc16eb-1eeb-4e74-b3ed-7c3d5394ddf9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070496 Jul 26 17:16:10.523933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 240/416] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:16:10.579905 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-61be80cb-ffc7-426b-82de-031a4256c024 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:10.590326 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-61be80cb-ffc7-426b-82de-031a4256c024 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.274797 Jul 26 17:16:10.591656 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 177/417] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:10 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:11.248410 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-471bfa98-a89d-4fc9-ac92-6812b68311da tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:11.251024 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-471bfa98-a89d-4fc9-ac92-6812b68311da tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:11.265971 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-471bfa98-a89d-4fc9-ac92-6812b68311da tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:11.267085 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-471bfa98-a89d-4fc9-ac92-6812b68311da tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:11.268423 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-471bfa98-a89d-4fc9-ac92-6812b68311da tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:11.269514 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-471bfa98-a89d-4fc9-ac92-6812b68311da tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:11.482827 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-471bfa98-a89d-4fc9-ac92-6812b68311da tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:11.492784 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-471bfa98-a89d-4fc9-ac92-6812b68311da tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:11.494453 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-471bfa98-a89d-4fc9-ac92-6812b68311da tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:11.496244 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-471bfa98-a89d-4fc9-ac92-6812b68311da tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1723 microversion: 2.20 time: 0.253326 Jul 26 17:16:11.497579 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 241/418] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:11 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:11.633583 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d97da06d-3ee5-483b-9a46-b92ab93ea3d7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:11.636859 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d97da06d-3ee5-483b-9a46-b92ab93ea3d7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:11.654380 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d97da06d-3ee5-483b-9a46-b92ab93ea3d7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:11.654999 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d97da06d-3ee5-483b-9a46-b92ab93ea3d7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:11.656367 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d97da06d-3ee5-483b-9a46-b92ab93ea3d7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:11.657116 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d97da06d-3ee5-483b-9a46-b92ab93ea3d7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:11.892397 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d97da06d-3ee5-483b-9a46-b92ab93ea3d7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:11.903647 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d97da06d-3ee5-483b-9a46-b92ab93ea3d7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.284337 Jul 26 17:16:11.905139 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 178/419] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:11 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:12.551134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-672e03a1-d2f8-4764-b38c-94d8d7696a42 req-af84ea2f-f340-4ba8-8b5e-0854316e9fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7d66fd-65f0-4c03-8f1e-93d1ec23d411", "name": "network-vif-unplugged", "status": "completed", "tag": "5a304d69-32d1-40aa-b33c-fe4e3d47a965"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:16:12.552597 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-086d7350-d340-4a0e-90de-c6b54672f6b6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:12.553277 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-086d7350-d340-4a0e-90de-c6b54672f6b6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:12.567635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-086d7350-d340-4a0e-90de-c6b54672f6b6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:12.568734 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-086d7350-d340-4a0e-90de-c6b54672f6b6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:12.569878 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-086d7350-d340-4a0e-90de-c6b54672f6b6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:12.570008 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-672e03a1-d2f8-4764-b38c-94d8d7696a42 req-af84ea2f-f340-4ba8-8b5e-0854316e9fdf service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:12.571254 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-672e03a1-d2f8-4764-b38c-94d8d7696a42 req-af84ea2f-f340-4ba8-8b5e-0854316e9fdf service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:12.571948 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-086d7350-d340-4a0e-90de-c6b54672f6b6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:12.587045 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-672e03a1-d2f8-4764-b38c-94d8d7696a42 req-af84ea2f-f340-4ba8-8b5e-0854316e9fdf service nova] Creating event network-vif-unplugged:5a304d69-32d1-40aa-b33c-fe4e3d47a965 for instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 on hv-cinder-83538 Jul 26 17:16:12.594332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-672e03a1-d2f8-4764-b38c-94d8d7696a42 req-af84ea2f-f340-4ba8-8b5e-0854316e9fdf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050355 Jul 26 17:16:12.595907 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 179/420] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:16:12.942471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-bd93b800-cbb7-40d3-9d11-7a0276d73cff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:12.943411 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-bd93b800-cbb7-40d3-9d11-7a0276d73cff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:12.950653 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bd93b800-cbb7-40d3-9d11-7a0276d73cff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:12.951409 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bd93b800-cbb7-40d3-9d11-7a0276d73cff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:12.952332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bd93b800-cbb7-40d3-9d11-7a0276d73cff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:12.952876 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bd93b800-cbb7-40d3-9d11-7a0276d73cff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:13.098932 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-086d7350-d340-4a0e-90de-c6b54672f6b6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:13.112832 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-086d7350-d340-4a0e-90de-c6b54672f6b6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:13.114541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-086d7350-d340-4a0e-90de-c6b54672f6b6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:13.115883 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-086d7350-d340-4a0e-90de-c6b54672f6b6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1723 microversion: 2.20 time: 0.581802 Jul 26 17:16:13.116560 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 242/421] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:12 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1723 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:16:13.139735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-bd93b800-cbb7-40d3-9d11-7a0276d73cff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:13.147516 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-bd93b800-cbb7-40d3-9d11-7a0276d73cff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.210044 Jul 26 17:16:13.148155 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 180/422] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:12 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:16:14.145618 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-24e91b67-7320-4704-8c51-f47183a3a161 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:14.146875 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-24e91b67-7320-4704-8c51-f47183a3a161 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:14.157249 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24e91b67-7320-4704-8c51-f47183a3a161 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:14.157562 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24e91b67-7320-4704-8c51-f47183a3a161 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:14.158355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24e91b67-7320-4704-8c51-f47183a3a161 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:14.158797 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24e91b67-7320-4704-8c51-f47183a3a161 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:14.171792 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4d446709-40e0-4d54-a4a7-ad18b20f1e52 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:14.172766 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4d446709-40e0-4d54-a4a7-ad18b20f1e52 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:14.182972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4d446709-40e0-4d54-a4a7-ad18b20f1e52 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:14.183676 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4d446709-40e0-4d54-a4a7-ad18b20f1e52 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:14.185889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4d446709-40e0-4d54-a4a7-ad18b20f1e52 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:14.186688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4d446709-40e0-4d54-a4a7-ad18b20f1e52 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:14.321931 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-24e91b67-7320-4704-8c51-f47183a3a161 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:14.335567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-24e91b67-7320-4704-8c51-f47183a3a161 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:14.338635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-24e91b67-7320-4704-8c51-f47183a3a161 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:14.340816 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-24e91b67-7320-4704-8c51-f47183a3a161 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1726 microversion: 2.20 time: 0.203321 Jul 26 17:16:14.341922 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 243/423] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:14 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1726 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:14.363397 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4d446709-40e0-4d54-a4a7-ad18b20f1e52 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:14.373714 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4d446709-40e0-4d54-a4a7-ad18b20f1e52 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.207882 Jul 26 17:16:14.374710 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 181/424] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:14 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:14.382291 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-83e19f3e-c907-4350-8f6a-c87c6d8557d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8b69d8a-3197-4ffe-81fd-8e44b13ae74f"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:16:14.385535 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-83e19f3e-c907-4350-8f6a-c87c6d8557d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:14.396024 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83e19f3e-c907-4350-8f6a-c87c6d8557d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:14.397251 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83e19f3e-c907-4350-8f6a-c87c6d8557d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:14.398804 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83e19f3e-c907-4350-8f6a-c87c6d8557d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:14.399779 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83e19f3e-c907-4350-8f6a-c87c6d8557d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:14.404840 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:16:14.742457 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-83e19f3e-c907-4350-8f6a-c87c6d8557d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "POST /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.366291 Jul 26 17:16:14.743092 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 244/425] 10.222.0.48 () {62 vars in 1364 bytes} [Tue Jul 26 17:16:14 2022] POST /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments => generated 188 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:16:14.897810 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-999d385b-b79d-409c-aa33-8c117b44a4d3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:16:14.898875 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-999d385b-b79d-409c-aa33-8c117b44a4d3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:14.910567 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-999d385b-b79d-409c-aa33-8c117b44a4d3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:14.911378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-999d385b-b79d-409c-aa33-8c117b44a4d3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:14.912791 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-999d385b-b79d-409c-aa33-8c117b44a4d3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:14.913616 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-999d385b-b79d-409c-aa33-8c117b44a4d3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:15.011558 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:16:15.038915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-999d385b-b79d-409c-aa33-8c117b44a4d3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "POST /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/action" status: 202 len: 0 microversion: 2.20 time: 0.148587 Jul 26 17:16:15.039513 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 182/426] 10.222.0.48 () {62 vars in 1319 bytes} [Tue Jul 26 17:16:14 2022] POST /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:16:15.053482 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-68776e77-aae8-4329-b765-979b627f7ff9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:15.054702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-68776e77-aae8-4329-b765-979b627f7ff9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:15.067029 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68776e77-aae8-4329-b765-979b627f7ff9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:15.067804 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68776e77-aae8-4329-b765-979b627f7ff9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:15.069283 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68776e77-aae8-4329-b765-979b627f7ff9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:15.070081 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68776e77-aae8-4329-b765-979b627f7ff9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:15.253637 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-68776e77-aae8-4329-b765-979b627f7ff9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:15.262512 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-68776e77-aae8-4329-b765-979b627f7ff9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:15.264167 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-68776e77-aae8-4329-b765-979b627f7ff9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:15.265533 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-68776e77-aae8-4329-b765-979b627f7ff9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1812 microversion: 2.20 time: 0.220451 Jul 26 17:16:15.280695 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 245/427] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:15 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1812 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:15.413022 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-28f119df-7dc2-4607-b42c-8a6593fb5397 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:15.414061 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-28f119df-7dc2-4607-b42c-8a6593fb5397 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:15.425436 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-28f119df-7dc2-4607-b42c-8a6593fb5397 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:15.426462 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-28f119df-7dc2-4607-b42c-8a6593fb5397 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:15.427216 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-28f119df-7dc2-4607-b42c-8a6593fb5397 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:15.427692 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-28f119df-7dc2-4607-b42c-8a6593fb5397 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:15.623036 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-28f119df-7dc2-4607-b42c-8a6593fb5397 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:15.631087 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-28f119df-7dc2-4607-b42c-8a6593fb5397 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.225301 Jul 26 17:16:15.631665 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 183/428] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:15 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:16:16.302271 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a6bf1a1c-6e0b-4595-b06a-6565bf9f3c58 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:16.304446 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a6bf1a1c-6e0b-4595-b06a-6565bf9f3c58 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:16.312922 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6bf1a1c-6e0b-4595-b06a-6565bf9f3c58 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:16.313638 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6bf1a1c-6e0b-4595-b06a-6565bf9f3c58 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:16.314603 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6bf1a1c-6e0b-4595-b06a-6565bf9f3c58 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:16.315209 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6bf1a1c-6e0b-4595-b06a-6565bf9f3c58 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:16.492361 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6bf1a1c-6e0b-4595-b06a-6565bf9f3c58 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:16.502073 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6bf1a1c-6e0b-4595-b06a-6565bf9f3c58 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:16.503840 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6bf1a1c-6e0b-4595-b06a-6565bf9f3c58 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:16.505029 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a6bf1a1c-6e0b-4595-b06a-6565bf9f3c58 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1812 microversion: 2.20 time: 0.207695 Jul 26 17:16:16.505584 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 246/429] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:16 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1812 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:16:16.654270 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-96e47307-1a68-475a-bae9-c5c082cf46f1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:16.654900 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-96e47307-1a68-475a-bae9-c5c082cf46f1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:16.661950 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-96e47307-1a68-475a-bae9-c5c082cf46f1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:16.662320 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-96e47307-1a68-475a-bae9-c5c082cf46f1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:16.663118 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-96e47307-1a68-475a-bae9-c5c082cf46f1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:16.663557 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-96e47307-1a68-475a-bae9-c5c082cf46f1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:16.858935 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-96e47307-1a68-475a-bae9-c5c082cf46f1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:16.866627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-96e47307-1a68-475a-bae9-c5c082cf46f1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1372 microversion: 2.1 time: 0.216868 Jul 26 17:16:16.868102 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 184/430] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:16 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:16:17.531591 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a06fd159-ea67-4490-8f07-f1871abb3708 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:17.531591 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a06fd159-ea67-4490-8f07-f1871abb3708 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:17.537642 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a06fd159-ea67-4490-8f07-f1871abb3708 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:17.538096 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a06fd159-ea67-4490-8f07-f1871abb3708 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:17.538875 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a06fd159-ea67-4490-8f07-f1871abb3708 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:17.539425 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a06fd159-ea67-4490-8f07-f1871abb3708 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:17.738193 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a06fd159-ea67-4490-8f07-f1871abb3708 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:17.768499 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a06fd159-ea67-4490-8f07-f1871abb3708 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:17.771625 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a06fd159-ea67-4490-8f07-f1871abb3708 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:17.774369 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a06fd159-ea67-4490-8f07-f1871abb3708 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1812 microversion: 2.20 time: 0.248748 Jul 26 17:16:17.775446 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 247/431] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:17 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1812 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:16:17.890936 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7f396ea8-1aea-475c-87c5-b7e1216c71e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:17.891552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7f396ea8-1aea-475c-87c5-b7e1216c71e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:17.904618 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7f396ea8-1aea-475c-87c5-b7e1216c71e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:17.905313 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7f396ea8-1aea-475c-87c5-b7e1216c71e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:17.906152 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7f396ea8-1aea-475c-87c5-b7e1216c71e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:17.906453 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7f396ea8-1aea-475c-87c5-b7e1216c71e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:18.058342 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7f396ea8-1aea-475c-87c5-b7e1216c71e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:18.066047 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7f396ea8-1aea-475c-87c5-b7e1216c71e1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1566 microversion: 2.1 time: 0.179415 Jul 26 17:16:18.066752 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 185/432] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:17 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:18.101756 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-942aacfb-0161-40b3-9af6-47d18f8f79cb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:18.102347 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-942aacfb-0161-40b3-9af6-47d18f8f79cb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:18.108851 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-942aacfb-0161-40b3-9af6-47d18f8f79cb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:18.109333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-942aacfb-0161-40b3-9af6-47d18f8f79cb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:18.110106 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-942aacfb-0161-40b3-9af6-47d18f8f79cb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:18.110535 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-942aacfb-0161-40b3-9af6-47d18f8f79cb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:18.197395 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-942aacfb-0161-40b3-9af6-47d18f8f79cb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099615 Jul 26 17:16:18.197992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 248/433] 10.222.0.48 () {58 vars in 1275 bytes} [Tue Jul 26 17:16:18 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:16:18.826540 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-bfbd4f84-16ab-49f0-823f-b0174ac04d2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:18.827907 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-bfbd4f84-16ab-49f0-823f-b0174ac04d2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:18.836947 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bfbd4f84-16ab-49f0-823f-b0174ac04d2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:18.837940 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bfbd4f84-16ab-49f0-823f-b0174ac04d2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:18.839635 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bfbd4f84-16ab-49f0-823f-b0174ac04d2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:18.841090 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bfbd4f84-16ab-49f0-823f-b0174ac04d2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:19.167352 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-bfbd4f84-16ab-49f0-823f-b0174ac04d2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:19.177250 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-bfbd4f84-16ab-49f0-823f-b0174ac04d2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:19.178807 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-bfbd4f84-16ab-49f0-823f-b0174ac04d2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:19.180039 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-bfbd4f84-16ab-49f0-823f-b0174ac04d2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1754 microversion: 2.20 time: 0.361927 Jul 26 17:16:19.180812 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 186/434] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:18 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1754 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:19.505162 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-6f0437bd-2a77-4021-ab87-ce7368f70715 req-f9ab88da-426d-42f5-91be-5b9634a16961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7701e238-d4bd-4e91-9ae9-9a5845f8a1ce", "tag": "d2849b37-4de3-40c3-97ec-d1f87c72f88f"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:16:19.521501 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-6f0437bd-2a77-4021-ab87-ce7368f70715 req-f9ab88da-426d-42f5-91be-5b9634a16961 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:19.522138 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-6f0437bd-2a77-4021-ab87-ce7368f70715 req-f9ab88da-426d-42f5-91be-5b9634a16961 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:19.539038 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-6f0437bd-2a77-4021-ab87-ce7368f70715 req-f9ab88da-426d-42f5-91be-5b9634a16961 service nova] Creating event network-changed:d2849b37-4de3-40c3-97ec-d1f87c72f88f for instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce on hv-cinder-83538 Jul 26 17:16:19.545073 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-6f0437bd-2a77-4021-ab87-ce7368f70715 req-f9ab88da-426d-42f5-91be-5b9634a16961 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047757 Jul 26 17:16:19.545716 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 249/435] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:16:20.228018 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-de14c550-b301-47fd-8919-05251b6a3223 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:20.228995 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-de14c550-b301-47fd-8919-05251b6a3223 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:20.236906 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-de14c550-b301-47fd-8919-05251b6a3223 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:20.237385 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-de14c550-b301-47fd-8919-05251b6a3223 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:20.238165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-de14c550-b301-47fd-8919-05251b6a3223 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:20.238590 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-de14c550-b301-47fd-8919-05251b6a3223 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:20.448424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-de14c550-b301-47fd-8919-05251b6a3223 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:20.457922 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-de14c550-b301-47fd-8919-05251b6a3223 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:20.459537 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-de14c550-b301-47fd-8919-05251b6a3223 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:20.460856 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-de14c550-b301-47fd-8919-05251b6a3223 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1754 microversion: 2.20 time: 0.237015 Jul 26 17:16:20.461536 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 187/436] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:20 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1754 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:21.494289 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b67a87cf-c6a5-46bc-8444-b8b7093068a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:21.495132 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b67a87cf-c6a5-46bc-8444-b8b7093068a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:21.502377 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b67a87cf-c6a5-46bc-8444-b8b7093068a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:21.502836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b67a87cf-c6a5-46bc-8444-b8b7093068a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:21.503658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b67a87cf-c6a5-46bc-8444-b8b7093068a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:21.504287 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b67a87cf-c6a5-46bc-8444-b8b7093068a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:21.701753 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b67a87cf-c6a5-46bc-8444-b8b7093068a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:21.713758 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b67a87cf-c6a5-46bc-8444-b8b7093068a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:21.716379 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b67a87cf-c6a5-46bc-8444-b8b7093068a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:21.717826 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b67a87cf-c6a5-46bc-8444-b8b7093068a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1754 microversion: 2.20 time: 0.230819 Jul 26 17:16:21.718475 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 250/437] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:21 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1754 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:22.753832 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-505cbdfd-27bd-41b8-9418-213bdf6ab988 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:22.755002 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-505cbdfd-27bd-41b8-9418-213bdf6ab988 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:22.758214 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:16:22.767372 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-505cbdfd-27bd-41b8-9418-213bdf6ab988 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:22.768172 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-505cbdfd-27bd-41b8-9418-213bdf6ab988 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:22.769570 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-505cbdfd-27bd-41b8-9418-213bdf6ab988 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:22.770478 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-505cbdfd-27bd-41b8-9418-213bdf6ab988 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:22.918009 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-505cbdfd-27bd-41b8-9418-213bdf6ab988 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:22.926806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-505cbdfd-27bd-41b8-9418-213bdf6ab988 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:22.928322 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-505cbdfd-27bd-41b8-9418-213bdf6ab988 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:22.929533 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-505cbdfd-27bd-41b8-9418-213bdf6ab988 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1754 microversion: 2.20 time: 0.180159 Jul 26 17:16:22.930093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 188/438] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:22 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:23.954294 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-68fb3a95-34e3-4759-bf75-ab63d772ab4a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:23.954936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-68fb3a95-34e3-4759-bf75-ab63d772ab4a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:23.957486 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=56 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:16:23.963093 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68fb3a95-34e3-4759-bf75-ab63d772ab4a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:23.963547 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68fb3a95-34e3-4759-bf75-ab63d772ab4a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:23.964325 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68fb3a95-34e3-4759-bf75-ab63d772ab4a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:23.964760 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68fb3a95-34e3-4759-bf75-ab63d772ab4a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:24.115779 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-68fb3a95-34e3-4759-bf75-ab63d772ab4a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:24.125836 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-68fb3a95-34e3-4759-bf75-ab63d772ab4a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:24.127531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-68fb3a95-34e3-4759-bf75-ab63d772ab4a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:24.128572 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-68fb3a95-34e3-4759-bf75-ab63d772ab4a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1754 microversion: 2.20 time: 0.178906 Jul 26 17:16:24.129230 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 251/439] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:23 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:25.155277 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-bb857a42-389d-4617-aea2-5c7adc22c678 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:25.155957 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-bb857a42-389d-4617-aea2-5c7adc22c678 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:25.162750 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bb857a42-389d-4617-aea2-5c7adc22c678 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:25.163201 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bb857a42-389d-4617-aea2-5c7adc22c678 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:25.163974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bb857a42-389d-4617-aea2-5c7adc22c678 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:25.164413 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bb857a42-389d-4617-aea2-5c7adc22c678 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:25.343207 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-bb857a42-389d-4617-aea2-5c7adc22c678 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:25.356739 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-bb857a42-389d-4617-aea2-5c7adc22c678 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:25.359666 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-bb857a42-389d-4617-aea2-5c7adc22c678 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:25.361922 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-bb857a42-389d-4617-aea2-5c7adc22c678 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1754 microversion: 2.20 time: 0.211281 Jul 26 17:16:25.362833 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 189/440] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:25 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1754 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:26.386685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e8000e5a-2e79-410b-b01e-b08505dd7f7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:26.388234 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e8000e5a-2e79-410b-b01e-b08505dd7f7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:26.395385 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8000e5a-2e79-410b-b01e-b08505dd7f7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:26.395841 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8000e5a-2e79-410b-b01e-b08505dd7f7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:26.396633 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8000e5a-2e79-410b-b01e-b08505dd7f7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:26.397375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8000e5a-2e79-410b-b01e-b08505dd7f7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:26.601753 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e8000e5a-2e79-410b-b01e-b08505dd7f7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:26.616816 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e8000e5a-2e79-410b-b01e-b08505dd7f7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:26.619764 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e8000e5a-2e79-410b-b01e-b08505dd7f7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:26.622676 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e8000e5a-2e79-410b-b01e-b08505dd7f7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1754 microversion: 2.20 time: 0.238955 Jul 26 17:16:26.623728 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 252/441] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:26 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1754 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:16:27.660671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-799f6e60-1bd9-4489-920e-46911c1e5c66 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:27.661341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-799f6e60-1bd9-4489-920e-46911c1e5c66 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:27.668693 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-799f6e60-1bd9-4489-920e-46911c1e5c66 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:27.669194 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-799f6e60-1bd9-4489-920e-46911c1e5c66 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:27.670003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-799f6e60-1bd9-4489-920e-46911c1e5c66 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:27.670448 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-799f6e60-1bd9-4489-920e-46911c1e5c66 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:27.826929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-799f6e60-1bd9-4489-920e-46911c1e5c66 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:27.840018 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-799f6e60-1bd9-4489-920e-46911c1e5c66 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:27.843147 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-799f6e60-1bd9-4489-920e-46911c1e5c66 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:27.845604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-799f6e60-1bd9-4489-920e-46911c1e5c66 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1754 microversion: 2.20 time: 0.188629 Jul 26 17:16:27.846209 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 190/442] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:27 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1754 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:28.883984 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a0ae68a8-b1eb-409e-9b78-7080e6808fe9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:28.885267 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a0ae68a8-b1eb-409e-9b78-7080e6808fe9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:28.915890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0ae68a8-b1eb-409e-9b78-7080e6808fe9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:28.916730 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0ae68a8-b1eb-409e-9b78-7080e6808fe9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:28.926107 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0ae68a8-b1eb-409e-9b78-7080e6808fe9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:28.927211 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0ae68a8-b1eb-409e-9b78-7080e6808fe9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:29.159749 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0ae68a8-b1eb-409e-9b78-7080e6808fe9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:29.177496 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0ae68a8-b1eb-409e-9b78-7080e6808fe9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:29.180075 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0ae68a8-b1eb-409e-9b78-7080e6808fe9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:29.181784 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a0ae68a8-b1eb-409e-9b78-7080e6808fe9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1754 microversion: 2.20 time: 0.304534 Jul 26 17:16:29.182611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 253/443] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:28 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1754 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:30.218860 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-80c79804-4b0d-4f0a-be36-b645c81afe00 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:30.219463 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-80c79804-4b0d-4f0a-be36-b645c81afe00 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:30.232468 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-80c79804-4b0d-4f0a-be36-b645c81afe00 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:30.232925 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-80c79804-4b0d-4f0a-be36-b645c81afe00 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:30.233743 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-80c79804-4b0d-4f0a-be36-b645c81afe00 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:30.234193 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-80c79804-4b0d-4f0a-be36-b645c81afe00 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:30.370646 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-80c79804-4b0d-4f0a-be36-b645c81afe00 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:30.380120 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-80c79804-4b0d-4f0a-be36-b645c81afe00 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:30.381633 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-80c79804-4b0d-4f0a-be36-b645c81afe00 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:30.383697 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-80c79804-4b0d-4f0a-be36-b645c81afe00 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1754 microversion: 2.20 time: 0.167943 Jul 26 17:16:30.383697 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 191/444] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:30 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:31.407709 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-52302634-628f-4d77-a2d0-8f824544e537 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:31.408363 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-52302634-628f-4d77-a2d0-8f824544e537 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:31.415558 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52302634-628f-4d77-a2d0-8f824544e537 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:31.415907 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52302634-628f-4d77-a2d0-8f824544e537 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:31.416681 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52302634-628f-4d77-a2d0-8f824544e537 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:31.417421 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52302634-628f-4d77-a2d0-8f824544e537 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:31.562432 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-52302634-628f-4d77-a2d0-8f824544e537 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:31.572279 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-52302634-628f-4d77-a2d0-8f824544e537 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:31.574099 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-52302634-628f-4d77-a2d0-8f824544e537 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:31.576297 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-52302634-628f-4d77-a2d0-8f824544e537 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1754 microversion: 2.20 time: 0.173284 Jul 26 17:16:31.577391 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 254/445] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:31 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:32.602311 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a7873130-9fb3-4406-959d-da3b4dc60f4b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:32.603180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a7873130-9fb3-4406-959d-da3b4dc60f4b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:32.611151 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7873130-9fb3-4406-959d-da3b4dc60f4b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:32.611615 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7873130-9fb3-4406-959d-da3b4dc60f4b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:32.612392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7873130-9fb3-4406-959d-da3b4dc60f4b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:32.612829 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7873130-9fb3-4406-959d-da3b4dc60f4b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:32.774540 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a7873130-9fb3-4406-959d-da3b4dc60f4b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:32.784680 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a7873130-9fb3-4406-959d-da3b4dc60f4b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:32.786337 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a7873130-9fb3-4406-959d-da3b4dc60f4b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:32.788098 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a7873130-9fb3-4406-959d-da3b4dc60f4b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.189725 Jul 26 17:16:32.788737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 192/446] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:32 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:16:33.815682 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bb4e8a8e-b42e-440c-bdb5-eb2dc20a0115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:33.816411 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bb4e8a8e-b42e-440c-bdb5-eb2dc20a0115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:33.827604 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bb4e8a8e-b42e-440c-bdb5-eb2dc20a0115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:33.828050 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bb4e8a8e-b42e-440c-bdb5-eb2dc20a0115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:33.828834 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bb4e8a8e-b42e-440c-bdb5-eb2dc20a0115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:33.829307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bb4e8a8e-b42e-440c-bdb5-eb2dc20a0115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:34.070933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bb4e8a8e-b42e-440c-bdb5-eb2dc20a0115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:34.084218 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bb4e8a8e-b42e-440c-bdb5-eb2dc20a0115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:34.086310 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bb4e8a8e-b42e-440c-bdb5-eb2dc20a0115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:34.087773 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bb4e8a8e-b42e-440c-bdb5-eb2dc20a0115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.279364 Jul 26 17:16:34.088423 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 255/447] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:33 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:35.133637 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-16625996-2e94-49c6-9cdb-ca410d8ded3c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:35.136085 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-16625996-2e94-49c6-9cdb-ca410d8ded3c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:35.154493 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-16625996-2e94-49c6-9cdb-ca410d8ded3c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:35.155248 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-16625996-2e94-49c6-9cdb-ca410d8ded3c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:35.156599 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-16625996-2e94-49c6-9cdb-ca410d8ded3c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:35.157371 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-16625996-2e94-49c6-9cdb-ca410d8ded3c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:35.470422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-16625996-2e94-49c6-9cdb-ca410d8ded3c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:35.490531 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-16625996-2e94-49c6-9cdb-ca410d8ded3c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:35.494601 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-16625996-2e94-49c6-9cdb-ca410d8ded3c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:35.497766 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-16625996-2e94-49c6-9cdb-ca410d8ded3c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.373157 Jul 26 17:16:35.515536 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 193/448] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:35 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:36.549468 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2160a5d1-df6f-4c61-bf19-3b9761471be0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:36.551782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2160a5d1-df6f-4c61-bf19-3b9761471be0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:36.573832 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2160a5d1-df6f-4c61-bf19-3b9761471be0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:36.575817 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2160a5d1-df6f-4c61-bf19-3b9761471be0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:36.577691 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2160a5d1-df6f-4c61-bf19-3b9761471be0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:36.578818 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2160a5d1-df6f-4c61-bf19-3b9761471be0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:36.793536 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2160a5d1-df6f-4c61-bf19-3b9761471be0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:36.804286 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2160a5d1-df6f-4c61-bf19-3b9761471be0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:36.807360 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2160a5d1-df6f-4c61-bf19-3b9761471be0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:36.809142 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2160a5d1-df6f-4c61-bf19-3b9761471be0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.267544 Jul 26 17:16:36.810117 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 256/449] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:36 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:37.838261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-75947543-4aee-4a3b-926d-2b2171ceecb8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:37.841450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-75947543-4aee-4a3b-926d-2b2171ceecb8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:37.853301 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-75947543-4aee-4a3b-926d-2b2171ceecb8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:37.854164 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-75947543-4aee-4a3b-926d-2b2171ceecb8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:37.855310 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-75947543-4aee-4a3b-926d-2b2171ceecb8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:37.856661 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-75947543-4aee-4a3b-926d-2b2171ceecb8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:38.071778 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-75947543-4aee-4a3b-926d-2b2171ceecb8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:38.116099 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-75947543-4aee-4a3b-926d-2b2171ceecb8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:38.119136 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-75947543-4aee-4a3b-926d-2b2171ceecb8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:38.120918 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-75947543-4aee-4a3b-926d-2b2171ceecb8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.289709 Jul 26 17:16:38.125362 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 194/450] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:37 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:39.146323 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1267340e-30e9-46bd-8a2b-8de759f292fc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:39.147002 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1267340e-30e9-46bd-8a2b-8de759f292fc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:39.154462 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1267340e-30e9-46bd-8a2b-8de759f292fc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:39.154915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1267340e-30e9-46bd-8a2b-8de759f292fc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:39.155693 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1267340e-30e9-46bd-8a2b-8de759f292fc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:39.156139 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1267340e-30e9-46bd-8a2b-8de759f292fc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:39.339187 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1267340e-30e9-46bd-8a2b-8de759f292fc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:39.352706 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1267340e-30e9-46bd-8a2b-8de759f292fc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:39.354546 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1267340e-30e9-46bd-8a2b-8de759f292fc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:39.356540 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1267340e-30e9-46bd-8a2b-8de759f292fc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.213511 Jul 26 17:16:39.357289 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 257/451] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:39 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:40.386452 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0440cbe1-764c-45ea-887c-6f692bd7e740 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:40.387921 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0440cbe1-764c-45ea-887c-6f692bd7e740 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:40.394345 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0440cbe1-764c-45ea-887c-6f692bd7e740 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:40.394673 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0440cbe1-764c-45ea-887c-6f692bd7e740 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:40.395449 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0440cbe1-764c-45ea-887c-6f692bd7e740 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:40.395881 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0440cbe1-764c-45ea-887c-6f692bd7e740 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:40.559552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0440cbe1-764c-45ea-887c-6f692bd7e740 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:40.568448 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0440cbe1-764c-45ea-887c-6f692bd7e740 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:40.570060 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0440cbe1-764c-45ea-887c-6f692bd7e740 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:40.571255 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0440cbe1-764c-45ea-887c-6f692bd7e740 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.189076 Jul 26 17:16:40.571815 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 195/452] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:40 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:16:41.599593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7b5e24ab-39a4-4420-b20d-0a0781bf1ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:41.600926 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7b5e24ab-39a4-4420-b20d-0a0781bf1ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:41.614154 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b5e24ab-39a4-4420-b20d-0a0781bf1ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:41.615310 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b5e24ab-39a4-4420-b20d-0a0781bf1ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:41.617068 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b5e24ab-39a4-4420-b20d-0a0781bf1ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:41.618137 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b5e24ab-39a4-4420-b20d-0a0781bf1ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:41.812485 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7b5e24ab-39a4-4420-b20d-0a0781bf1ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:41.827373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7b5e24ab-39a4-4420-b20d-0a0781bf1ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:41.829017 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7b5e24ab-39a4-4420-b20d-0a0781bf1ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:41.830244 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7b5e24ab-39a4-4420-b20d-0a0781bf1ac6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.237629 Jul 26 17:16:41.830818 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 258/453] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:41 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:42.859307 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-46f7fee9-1f3f-4a0d-a398-d89681392fae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:42.862580 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-46f7fee9-1f3f-4a0d-a398-d89681392fae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:42.878044 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-46f7fee9-1f3f-4a0d-a398-d89681392fae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:42.880608 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-46f7fee9-1f3f-4a0d-a398-d89681392fae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:42.882421 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-46f7fee9-1f3f-4a0d-a398-d89681392fae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:42.883628 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-46f7fee9-1f3f-4a0d-a398-d89681392fae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:43.137640 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-46f7fee9-1f3f-4a0d-a398-d89681392fae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:43.168985 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-46f7fee9-1f3f-4a0d-a398-d89681392fae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:43.186471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-46f7fee9-1f3f-4a0d-a398-d89681392fae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:43.188694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-46f7fee9-1f3f-4a0d-a398-d89681392fae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.336563 Jul 26 17:16:43.189792 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 196/454] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:42 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:44.228520 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-91a2f767-204b-488c-8ca6-a6d75bf87822 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:44.232843 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-91a2f767-204b-488c-8ca6-a6d75bf87822 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:44.243931 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91a2f767-204b-488c-8ca6-a6d75bf87822 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:44.249828 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91a2f767-204b-488c-8ca6-a6d75bf87822 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:44.252363 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91a2f767-204b-488c-8ca6-a6d75bf87822 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:44.253454 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91a2f767-204b-488c-8ca6-a6d75bf87822 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:44.262697 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:16:44.456949 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-91a2f767-204b-488c-8ca6-a6d75bf87822 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:44.474358 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-91a2f767-204b-488c-8ca6-a6d75bf87822 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:44.477562 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-91a2f767-204b-488c-8ca6-a6d75bf87822 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:44.478925 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-91a2f767-204b-488c-8ca6-a6d75bf87822 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.259383 Jul 26 17:16:44.479508 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 259/455] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:44 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:45.510259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1cc41f3c-4c07-4178-96b6-93a24b5f0d5d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:45.515734 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1cc41f3c-4c07-4178-96b6-93a24b5f0d5d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:45.527342 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1cc41f3c-4c07-4178-96b6-93a24b5f0d5d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:45.529227 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1cc41f3c-4c07-4178-96b6-93a24b5f0d5d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:45.530950 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1cc41f3c-4c07-4178-96b6-93a24b5f0d5d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:45.532156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1cc41f3c-4c07-4178-96b6-93a24b5f0d5d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:45.542285 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:16:45.749656 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1cc41f3c-4c07-4178-96b6-93a24b5f0d5d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:45.762968 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1cc41f3c-4c07-4178-96b6-93a24b5f0d5d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:45.766143 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1cc41f3c-4c07-4178-96b6-93a24b5f0d5d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:45.768495 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1cc41f3c-4c07-4178-96b6-93a24b5f0d5d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.267475 Jul 26 17:16:45.769621 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 197/456] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:45 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:46.795037 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2c5253fc-b566-4355-8acc-320e8af4c8fe tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:46.795777 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2c5253fc-b566-4355-8acc-320e8af4c8fe tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:46.804313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c5253fc-b566-4355-8acc-320e8af4c8fe tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:46.804922 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c5253fc-b566-4355-8acc-320e8af4c8fe tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:46.805832 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c5253fc-b566-4355-8acc-320e8af4c8fe tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:46.806350 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c5253fc-b566-4355-8acc-320e8af4c8fe tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:46.959526 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2c5253fc-b566-4355-8acc-320e8af4c8fe tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:46.969428 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2c5253fc-b566-4355-8acc-320e8af4c8fe tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:46.970956 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2c5253fc-b566-4355-8acc-320e8af4c8fe tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:46.972132 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2c5253fc-b566-4355-8acc-320e8af4c8fe tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.182420 Jul 26 17:16:46.972699 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 260/457] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:46 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:47.996763 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-33280d45-38a2-421d-8a67-5bcb37d028d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:47.998255 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-33280d45-38a2-421d-8a67-5bcb37d028d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:48.005786 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-33280d45-38a2-421d-8a67-5bcb37d028d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:48.006243 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-33280d45-38a2-421d-8a67-5bcb37d028d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:48.007036 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-33280d45-38a2-421d-8a67-5bcb37d028d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:48.007479 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-33280d45-38a2-421d-8a67-5bcb37d028d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:48.162442 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-33280d45-38a2-421d-8a67-5bcb37d028d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:48.172051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-33280d45-38a2-421d-8a67-5bcb37d028d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:48.173530 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-33280d45-38a2-421d-8a67-5bcb37d028d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:48.174720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-33280d45-38a2-421d-8a67-5bcb37d028d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.182256 Jul 26 17:16:48.175326 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 198/458] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:47 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:49.203099 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9b77addd-0246-443e-b67c-066b4e8fa889 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:49.203800 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9b77addd-0246-443e-b67c-066b4e8fa889 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:49.210394 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9b77addd-0246-443e-b67c-066b4e8fa889 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:49.210847 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9b77addd-0246-443e-b67c-066b4e8fa889 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:49.211628 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9b77addd-0246-443e-b67c-066b4e8fa889 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:49.212057 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9b77addd-0246-443e-b67c-066b4e8fa889 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:49.376827 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9b77addd-0246-443e-b67c-066b4e8fa889 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:49.388755 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9b77addd-0246-443e-b67c-066b4e8fa889 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:49.390631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9b77addd-0246-443e-b67c-066b4e8fa889 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:49.391894 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9b77addd-0246-443e-b67c-066b4e8fa889 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.192856 Jul 26 17:16:49.392442 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 261/459] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:49 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:49.426595 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-469f093c-ed50-4124-9798-3950c40ae253 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:49.427456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-469f093c-ed50-4124-9798-3950c40ae253 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:49.435570 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-469f093c-ed50-4124-9798-3950c40ae253 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:49.436030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-469f093c-ed50-4124-9798-3950c40ae253 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:49.436902 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-469f093c-ed50-4124-9798-3950c40ae253 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:49.437431 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-469f093c-ed50-4124-9798-3950c40ae253 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:49.586201 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.objects.instance [None req-469f093c-ed50-4124-9798-3950c40ae253 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lazy-loading 'services' on Instance uuid af4c1664-d4a2-4f59-8f45-2025f237a3cc {{(pid=118122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:16:49.760317 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-469f093c-ed50-4124-9798-3950c40ae253 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "DELETE /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc/os-volume_attachments/b0289e8b-97ee-4dca-acfe-6e66d8d93883" status: 202 len: 0 microversion: 2.1 time: 0.341026 Jul 26 17:16:49.760913 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 199/460] 10.222.0.48 () {58 vars in 1416 bytes} [Tue Jul 26 17:16:49 2022] DELETE /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc/os-volume_attachments/b0289e8b-97ee-4dca-acfe-6e66d8d93883 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:16:50.429370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bf3b8685-3a8a-4b63-a737-bc5f830bf582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:50.430659 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bf3b8685-3a8a-4b63-a737-bc5f830bf582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:50.446201 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf3b8685-3a8a-4b63-a737-bc5f830bf582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:50.447421 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf3b8685-3a8a-4b63-a737-bc5f830bf582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:50.455271 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf3b8685-3a8a-4b63-a737-bc5f830bf582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:50.458105 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf3b8685-3a8a-4b63-a737-bc5f830bf582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:50.685469 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bf3b8685-3a8a-4b63-a737-bc5f830bf582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:50.701542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bf3b8685-3a8a-4b63-a737-bc5f830bf582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:50.704631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bf3b8685-3a8a-4b63-a737-bc5f830bf582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:50.706956 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bf3b8685-3a8a-4b63-a737-bc5f830bf582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.283497 Jul 26 17:16:50.708147 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 262/461] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:50 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:51.749904 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f34bee41-5517-4674-954b-bfbcf5c37455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:51.750569 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-f34bee41-5517-4674-954b-bfbcf5c37455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:51.758067 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f34bee41-5517-4674-954b-bfbcf5c37455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:51.758529 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f34bee41-5517-4674-954b-bfbcf5c37455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:51.759326 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f34bee41-5517-4674-954b-bfbcf5c37455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:51.759769 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f34bee41-5517-4674-954b-bfbcf5c37455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:51.935886 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-f34bee41-5517-4674-954b-bfbcf5c37455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:51.947685 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-f34bee41-5517-4674-954b-bfbcf5c37455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:51.948931 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-f34bee41-5517-4674-954b-bfbcf5c37455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:51.950960 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-f34bee41-5517-4674-954b-bfbcf5c37455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.206458 Jul 26 17:16:51.967459 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 200/462] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:51 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:51.994208 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-39eb2668-4ef6-44e1-8801-982a72cd2c41 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:51.994932 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-39eb2668-4ef6-44e1-8801-982a72cd2c41 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:52.003339 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-39eb2668-4ef6-44e1-8801-982a72cd2c41 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:52.003682 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-39eb2668-4ef6-44e1-8801-982a72cd2c41 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:52.004492 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-39eb2668-4ef6-44e1-8801-982a72cd2c41 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:52.004913 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-39eb2668-4ef6-44e1-8801-982a72cd2c41 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:52.038450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-39eb2668-4ef6-44e1-8801-982a72cd2c41 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:16:52.157167 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-39eb2668-4ef6-44e1-8801-982a72cd2c41 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "DELETE /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 204 len: 0 microversion: 2.1 time: 0.167734 Jul 26 17:16:52.158860 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 263/463] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:16:51 2022] DELETE /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:16:52.174438 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-de91afa2-b8d0-4deb-9ed9-79fd03ff1a04 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:52.174438 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-de91afa2-b8d0-4deb-9ed9-79fd03ff1a04 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:52.179951 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-de91afa2-b8d0-4deb-9ed9-79fd03ff1a04 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:52.180419 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-de91afa2-b8d0-4deb-9ed9-79fd03ff1a04 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:52.181544 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-de91afa2-b8d0-4deb-9ed9-79fd03ff1a04 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:52.182265 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-de91afa2-b8d0-4deb-9ed9-79fd03ff1a04 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:52.352178 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-de91afa2-b8d0-4deb-9ed9-79fd03ff1a04 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:52.363347 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-de91afa2-b8d0-4deb-9ed9-79fd03ff1a04 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1511 microversion: 2.1 time: 0.199583 Jul 26 17:16:52.364245 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 201/464] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:52 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:52.978441 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bd7fc476-4071-4b9d-892b-5fb115231b7e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:52.979475 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bd7fc476-4071-4b9d-892b-5fb115231b7e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:52.986741 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd7fc476-4071-4b9d-892b-5fb115231b7e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:52.987159 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd7fc476-4071-4b9d-892b-5fb115231b7e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:52.988199 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd7fc476-4071-4b9d-892b-5fb115231b7e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:52.988640 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd7fc476-4071-4b9d-892b-5fb115231b7e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:53.154995 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bd7fc476-4071-4b9d-892b-5fb115231b7e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:53.164688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bd7fc476-4071-4b9d-892b-5fb115231b7e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:53.166295 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bd7fc476-4071-4b9d-892b-5fb115231b7e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:53.167567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bd7fc476-4071-4b9d-892b-5fb115231b7e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.193336 Jul 26 17:16:53.168007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 264/465] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:52 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:53.387862 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ce5863a3-2929-4b4c-a362-0f1457963ee5 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:53.388644 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ce5863a3-2929-4b4c-a362-0f1457963ee5 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:53.391034 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=28 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:16:53.400754 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ce5863a3-2929-4b4c-a362-0f1457963ee5 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:53.401352 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ce5863a3-2929-4b4c-a362-0f1457963ee5 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:53.402194 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ce5863a3-2929-4b4c-a362-0f1457963ee5 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:53.403322 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ce5863a3-2929-4b4c-a362-0f1457963ee5 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:53.571546 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ce5863a3-2929-4b4c-a362-0f1457963ee5 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:53.580751 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ce5863a3-2929-4b4c-a362-0f1457963ee5 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1511 microversion: 2.1 time: 0.197324 Jul 26 17:16:53.581617 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 202/466] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:53 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:54.191467 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3a225683-0aaa-44a4-a125-916702c519ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:54.192076 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3a225683-0aaa-44a4-a125-916702c519ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:54.194582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:16:54.201690 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a225683-0aaa-44a4-a125-916702c519ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:54.202149 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a225683-0aaa-44a4-a125-916702c519ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:54.202937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a225683-0aaa-44a4-a125-916702c519ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:54.203566 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a225683-0aaa-44a4-a125-916702c519ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:54.370944 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3a225683-0aaa-44a4-a125-916702c519ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:54.389236 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3a225683-0aaa-44a4-a125-916702c519ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:54.391002 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3a225683-0aaa-44a4-a125-916702c519ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:54.392213 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3a225683-0aaa-44a4-a125-916702c519ae tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.204786 Jul 26 17:16:54.392774 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 265/467] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:54 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:54.604204 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f5db0c47-e26c-4ff2-b1d5-c2f8939c5b64 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:54.604822 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-f5db0c47-e26c-4ff2-b1d5-c2f8939c5b64 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:54.613466 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f5db0c47-e26c-4ff2-b1d5-c2f8939c5b64 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:54.614186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f5db0c47-e26c-4ff2-b1d5-c2f8939c5b64 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:54.615202 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f5db0c47-e26c-4ff2-b1d5-c2f8939c5b64 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:54.615697 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f5db0c47-e26c-4ff2-b1d5-c2f8939c5b64 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:55.247258 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-f5db0c47-e26c-4ff2-b1d5-c2f8939c5b64 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:55.258193 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-f5db0c47-e26c-4ff2-b1d5-c2f8939c5b64 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1511 microversion: 2.1 time: 0.658370 Jul 26 17:16:55.258743 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 203/468] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:54 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1511 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:55.422292 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a6800358-a6c9-4555-92c8-9ae64be6d655 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:55.422911 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a6800358-a6c9-4555-92c8-9ae64be6d655 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:55.433915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6800358-a6c9-4555-92c8-9ae64be6d655 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:55.437726 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6800358-a6c9-4555-92c8-9ae64be6d655 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:55.438565 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6800358-a6c9-4555-92c8-9ae64be6d655 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:55.439011 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6800358-a6c9-4555-92c8-9ae64be6d655 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:55.649532 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6800358-a6c9-4555-92c8-9ae64be6d655 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:55.667379 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6800358-a6c9-4555-92c8-9ae64be6d655 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:55.673517 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6800358-a6c9-4555-92c8-9ae64be6d655 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:55.676129 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a6800358-a6c9-4555-92c8-9ae64be6d655 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.259047 Jul 26 17:16:55.677226 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 266/469] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:55 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:56.293565 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-dd0d1db4-6dad-429d-aa3f-473e98619a06 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:56.294711 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-dd0d1db4-6dad-429d-aa3f-473e98619a06 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:56.314997 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dd0d1db4-6dad-429d-aa3f-473e98619a06 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:56.316133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dd0d1db4-6dad-429d-aa3f-473e98619a06 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:56.317820 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dd0d1db4-6dad-429d-aa3f-473e98619a06 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:56.318586 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dd0d1db4-6dad-429d-aa3f-473e98619a06 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:56.703817 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0a151355-dfd4-4b68-953b-fd4cfd33ff8b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:56.705812 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0a151355-dfd4-4b68-953b-fd4cfd33ff8b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:56.723829 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a151355-dfd4-4b68-953b-fd4cfd33ff8b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:56.725600 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a151355-dfd4-4b68-953b-fd4cfd33ff8b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:56.731922 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a151355-dfd4-4b68-953b-fd4cfd33ff8b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:56.732580 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a151355-dfd4-4b68-953b-fd4cfd33ff8b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:56.896434 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-dd0d1db4-6dad-429d-aa3f-473e98619a06 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:56.913781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-dd0d1db4-6dad-429d-aa3f-473e98619a06 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 200 len: 1511 microversion: 2.1 time: 0.634309 Jul 26 17:16:56.917238 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 204/470] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:56 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 1511 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:16:56.953960 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0a151355-dfd4-4b68-953b-fd4cfd33ff8b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:56.966693 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0a151355-dfd4-4b68-953b-fd4cfd33ff8b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:56.968658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0a151355-dfd4-4b68-953b-fd4cfd33ff8b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:56.970086 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0a151355-dfd4-4b68-953b-fd4cfd33ff8b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.273947 Jul 26 17:16:56.970828 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 267/471] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:56 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:57.062266 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-89d08d07-b74e-4d80-aa4c-31ccc4ad283b req-03964370-c930-4de0-9dde-afdce3d653d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4c1664-d4a2-4f59-8f45-2025f237a3cc", "name": "network-vif-deleted", "tag": "bfe45947-fc60-41ad-a94c-7cdebb82c3a9"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:16:57.117060 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-89d08d07-b74e-4d80-aa4c-31ccc4ad283b req-03964370-c930-4de0-9dde-afdce3d653d6 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:57.117530 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-89d08d07-b74e-4d80-aa4c-31ccc4ad283b req-03964370-c930-4de0-9dde-afdce3d653d6 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:57.142612 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-89d08d07-b74e-4d80-aa4c-31ccc4ad283b req-03964370-c930-4de0-9dde-afdce3d653d6 service nova] Creating event network-vif-deleted:bfe45947-fc60-41ad-a94c-7cdebb82c3a9 for instance af4c1664-d4a2-4f59-8f45-2025f237a3cc on hv-cinder-83538 Jul 26 17:16:57.149361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-89d08d07-b74e-4d80-aa4c-31ccc4ad283b req-03964370-c930-4de0-9dde-afdce3d653d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091191 Jul 26 17:16:57.150765 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 205/472] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:16:57.947292 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5ad88716-5056-4c41-a2e0-b7b03a0fb505 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:57.948661 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5ad88716-5056-4c41-a2e0-b7b03a0fb505 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: af4c1664-d4a2-4f59-8f45-2025f237a3cc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:57.961846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ad88716-5056-4c41-a2e0-b7b03a0fb505 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:57.962286 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ad88716-5056-4c41-a2e0-b7b03a0fb505 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:57.963083 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ad88716-5056-4c41-a2e0-b7b03a0fb505 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:57.963509 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ad88716-5056-4c41-a2e0-b7b03a0fb505 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:57.981551 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-5ad88716-5056-4c41-a2e0-b7b03a0fb505 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] HTTP exception thrown: Instance af4c1664-d4a2-4f59-8f45-2025f237a3cc could not be found. Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5ad88716-5056-4c41-a2e0-b7b03a0fb505 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Request method failure captured: Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc HTTP/1.1 Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CEXSJLv3ijl1TN_hJz0EKpUbnioCO-lpvHWQyoGalaGQrhGodsHfmRFUl9xOcaKmvqrFJHSfAUyHgpDLJoVDVOl3fE8W32HDLKHISZa7MZYbuDiGHomqpwMO9p3R30QFMxuWBGznhBwic0RXL1CQWro9ZjQisAjb5qN6WRpUPwbaLM Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: d379bf9c35444978b63c8a5a1e337928 Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesSnapshotTestJSON-867891461 Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:16:57.984260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:16:57.985990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d379bf9c35444978b63c8a5a1e337928"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d379bf9c35444978b63c8a5a1e337928"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d379bf9c35444978b63c8a5a1e337928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d379bf9c35444978b63c8a5a1e337928"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:16:57.985990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesSnapshotTestJSON-867891461 Jul 26 17:16:57.985990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: d379bf9c35444978b63c8a5a1e337928 Jul 26 17:16:57.985990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-867891461 Jul 26 17:16:57.985990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesSnapshotTestJSON-867891461-project Jul 26 17:16:57.985990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:16:57.985990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:16:57.985990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: 9d951f022d244c348e045966c33d5663 Jul 26 17:16:57.985990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesSnapshotTestJSON-867891461-project Jul 26 17:16:57.985990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:16:57.985990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance af4c1664-d4a2-4f59-8f45-2025f237a3cc could not be found. Jul 26 17:16:57.985990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': 'af4c1664-d4a2-4f59-8f45-2025f237a3cc'} Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af4c1664-d4a2-4f59-8f45-2025f237a3cc could not be found. Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:16:57.986904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af4c1664-d4a2-4f59-8f45-2025f237a3cc could not be found. Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af4c1664-d4a2-4f59-8f45-2025f237a3cc could not be found. Jul 26 17:16:57.988355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:16:57.989693 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5ad88716-5056-4c41-a2e0-b7b03a0fb505 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Returning 404 to user: Instance af4c1664-d4a2-4f59-8f45-2025f237a3cc could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:16:57.989693 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5ad88716-5056-4c41-a2e0-b7b03a0fb505 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc" status: 404 len: 111 microversion: 2.1 time: 0.042581 Jul 26 17:16:57.989693 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 268/473] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:16:57 2022] GET /compute/v2.1/servers/af4c1664-d4a2-4f59-8f45-2025f237a3cc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:16:57.998456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-603815f4-d609-4822-a0e6-f9c28ebad377 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:57.999961 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-603815f4-d609-4822-a0e6-f9c28ebad377 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:58.018505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-603815f4-d609-4822-a0e6-f9c28ebad377 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:58.019097 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-603815f4-d609-4822-a0e6-f9c28ebad377 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:58.020319 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-603815f4-d609-4822-a0e6-f9c28ebad377 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:58.021115 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-603815f4-d609-4822-a0e6-f9c28ebad377 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:58.435066 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-603815f4-d609-4822-a0e6-f9c28ebad377 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:58.471325 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-603815f4-d609-4822-a0e6-f9c28ebad377 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:58.474449 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-603815f4-d609-4822-a0e6-f9c28ebad377 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:58.477972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-603815f4-d609-4822-a0e6-f9c28ebad377 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.484362 Jul 26 17:16:58.489464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 206/474] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:57 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:16:59.517897 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-345ce40d-2923-4d9e-a351-581b74ba933a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:16:59.519715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-345ce40d-2923-4d9e-a351-581b74ba933a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:16:59.526821 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-345ce40d-2923-4d9e-a351-581b74ba933a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:59.527969 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-345ce40d-2923-4d9e-a351-581b74ba933a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:59.529472 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-345ce40d-2923-4d9e-a351-581b74ba933a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:16:59.529919 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-345ce40d-2923-4d9e-a351-581b74ba933a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:16:59.802787 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-345ce40d-2923-4d9e-a351-581b74ba933a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:59.814591 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-345ce40d-2923-4d9e-a351-581b74ba933a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:59.816570 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-345ce40d-2923-4d9e-a351-581b74ba933a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:16:59.819329 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-345ce40d-2923-4d9e-a351-581b74ba933a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.306820 Jul 26 17:16:59.820151 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 269/475] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:16:59 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:17:00.866359 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-abc6c084-2a53-47db-b56a-f60a6d2119e2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:00.872575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-abc6c084-2a53-47db-b56a-f60a6d2119e2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:00.888461 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-abc6c084-2a53-47db-b56a-f60a6d2119e2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:00.889244 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-abc6c084-2a53-47db-b56a-f60a6d2119e2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:00.890080 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-abc6c084-2a53-47db-b56a-f60a6d2119e2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:00.890546 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-abc6c084-2a53-47db-b56a-f60a6d2119e2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:01.075842 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-abc6c084-2a53-47db-b56a-f60a6d2119e2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:01.085720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-abc6c084-2a53-47db-b56a-f60a6d2119e2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:01.087240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-abc6c084-2a53-47db-b56a-f60a6d2119e2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:01.088494 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-abc6c084-2a53-47db-b56a-f60a6d2119e2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.236492 Jul 26 17:17:01.089068 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 207/476] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:17:00 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:17:02.113989 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-975c3779-b54f-4f11-a603-664ba828335a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:02.114677 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-975c3779-b54f-4f11-a603-664ba828335a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:02.125623 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-975c3779-b54f-4f11-a603-664ba828335a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:02.126389 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-975c3779-b54f-4f11-a603-664ba828335a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:02.127524 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-975c3779-b54f-4f11-a603-664ba828335a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:02.128137 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-975c3779-b54f-4f11-a603-664ba828335a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:02.405352 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-975c3779-b54f-4f11-a603-664ba828335a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:02.422568 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-975c3779-b54f-4f11-a603-664ba828335a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:02.424131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-975c3779-b54f-4f11-a603-664ba828335a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:02.425477 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-975c3779-b54f-4f11-a603-664ba828335a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.315464 Jul 26 17:17:02.426513 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 270/477] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:17:02 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:17:03.073646 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-8cfd78d5-20fd-45da-a2ff-aafd908066c6 req-215b3452-2bbf-4444-8a19-b6db22e14fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7d66fd-65f0-4c03-8f1e-93d1ec23d411", "name": "network-vif-plugged", "status": "completed", "tag": "5a304d69-32d1-40aa-b33c-fe4e3d47a965"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:03.101230 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-8cfd78d5-20fd-45da-a2ff-aafd908066c6 req-215b3452-2bbf-4444-8a19-b6db22e14fc2 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:03.102443 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-8cfd78d5-20fd-45da-a2ff-aafd908066c6 req-215b3452-2bbf-4444-8a19-b6db22e14fc2 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:03.156896 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-8cfd78d5-20fd-45da-a2ff-aafd908066c6 req-215b3452-2bbf-4444-8a19-b6db22e14fc2 service nova] Creating event network-vif-plugged:5a304d69-32d1-40aa-b33c-fe4e3d47a965 for instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 on hv-cinder-83538 Jul 26 17:17:03.180707 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-8cfd78d5-20fd-45da-a2ff-aafd908066c6 req-215b3452-2bbf-4444-8a19-b6db22e14fc2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113693 Jul 26 17:17:03.185283 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 208/478] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:17:03.451521 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-84c37ce9-a0bb-4276-899e-f666698cc291 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:03.452205 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-84c37ce9-a0bb-4276-899e-f666698cc291 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:03.458871 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84c37ce9-a0bb-4276-899e-f666698cc291 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:03.459432 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84c37ce9-a0bb-4276-899e-f666698cc291 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:03.460288 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84c37ce9-a0bb-4276-899e-f666698cc291 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:03.460798 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84c37ce9-a0bb-4276-899e-f666698cc291 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:03.841904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-84c37ce9-a0bb-4276-899e-f666698cc291 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:03.855232 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-84c37ce9-a0bb-4276-899e-f666698cc291 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:03.858092 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-84c37ce9-a0bb-4276-899e-f666698cc291 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:03.859755 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-84c37ce9-a0bb-4276-899e-f666698cc291 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.412779 Jul 26 17:17:03.862977 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 271/479] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:17:03 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:17:04.892543 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1290610f-9747-40a2-a3e6-ac49d6072621 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:04.894693 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1290610f-9747-40a2-a3e6-ac49d6072621 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:04.908099 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1290610f-9747-40a2-a3e6-ac49d6072621 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:04.908988 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1290610f-9747-40a2-a3e6-ac49d6072621 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:04.910696 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1290610f-9747-40a2-a3e6-ac49d6072621 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:04.911464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1290610f-9747-40a2-a3e6-ac49d6072621 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:05.217719 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f3c76f38-7911-498d-a04b-48277a585c52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:05.218929 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f3c76f38-7911-498d-a04b-48277a585c52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:05.227205 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3c76f38-7911-498d-a04b-48277a585c52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:05.227967 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3c76f38-7911-498d-a04b-48277a585c52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:05.229024 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3c76f38-7911-498d-a04b-48277a585c52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:05.229696 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3c76f38-7911-498d-a04b-48277a585c52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:05.241186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1290610f-9747-40a2-a3e6-ac49d6072621 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:05.271925 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1290610f-9747-40a2-a3e6-ac49d6072621 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:05.276325 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1290610f-9747-40a2-a3e6-ac49d6072621 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:05.280790 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f3c76f38-7911-498d-a04b-48277a585c52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6/ips" status: 200 len: 150 microversion: 2.1 time: 0.066681 Jul 26 17:17:05.288536 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 272/480] 10.222.0.48 () {58 vars in 1248 bytes} [Tue Jul 26 17:17:05 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6/ips => generated 150 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:17:05.288743 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1290610f-9747-40a2-a3e6-ac49d6072621 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.401989 Jul 26 17:17:05.288743 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 209/481] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:17:04 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:17:05.302962 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-190979e9-fd1c-41f4-9fa5-35ba6bcab097 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae9589ee-c4be-487e-bb4c-65101ac5d0b3"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:05.310329 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-190979e9-fd1c-41f4-9fa5-35ba6bcab097 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:05.318662 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-190979e9-fd1c-41f4-9fa5-35ba6bcab097 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:05.319131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-190979e9-fd1c-41f4-9fa5-35ba6bcab097 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:05.319969 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-190979e9-fd1c-41f4-9fa5-35ba6bcab097 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:05.320618 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-190979e9-fd1c-41f4-9fa5-35ba6bcab097 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:05.472763 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-190979e9-fd1c-41f4-9fa5-35ba6bcab097 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Invalid volume: volume ae9589ee-c4be-487e-bb4c-65101ac5d0b3 is already attached to instances: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-190979e9-fd1c-41f4-9fa5-35ba6bcab097 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: POST /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6/os-volume_attachments HTTP/1.1 Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 74 Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:17:05.474890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:17:05.476450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:17:05.476450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:17:05.476450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:17:05.476450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:17:05.476450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:17:05.476450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:17:05.476450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:17:05.476450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:17:05.476450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:17:05.476450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Jul 26 17:17:05.476450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {"volumeAttachment": {"volumeId": "ae9589ee-c4be-487e-bb4c-65101ac5d0b3"}} Jul 26 17:17:05.476450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Invalid volume: volume ae9589ee-c4be-487e-bb4c-65101ac5d0b3 is already attached to instances: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'server_id': 'db19722e-e060-4323-8b57-179687e601d6', 'body': {'volumeAttachment': {'volumeId': 'ae9589ee-c4be-487e-bb4c-65101ac5d0b3'}}} Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ae9589ee-c4be-487e-bb4c-65101ac5d0b3 is already attached to instances: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:17:05.477845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ae9589ee-c4be-487e-bb4c-65101ac5d0b3 is already attached to instances: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:17:05.479531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:17:05.481882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:17:05.481882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:17:05.481882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:17:05.481882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ae9589ee-c4be-487e-bb4c-65101ac5d0b3 is already attached to instances: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea Jul 26 17:17:05.481882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:17:05.483669 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-190979e9-fd1c-41f4-9fa5-35ba6bcab097 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 400 to user: Invalid volume: volume ae9589ee-c4be-487e-bb4c-65101ac5d0b3 is already attached to instances: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:17:05.484720 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-190979e9-fd1c-41f4-9fa5-35ba6bcab097 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.185911 Jul 26 17:17:05.489292 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 273/482] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:17:05 2022] POST /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6/os-volume_attachments => generated 174 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 17:17:05.498768 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-64d656ac-6cb6-430b-86d8-e88979fef559 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:05.501902 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-64d656ac-6cb6-430b-86d8-e88979fef559 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:05.516685 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-64d656ac-6cb6-430b-86d8-e88979fef559 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:05.519690 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-64d656ac-6cb6-430b-86d8-e88979fef559 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:05.521667 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-64d656ac-6cb6-430b-86d8-e88979fef559 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:05.523062 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-64d656ac-6cb6-430b-86d8-e88979fef559 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:05.582493 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-64d656ac-6cb6-430b-86d8-e88979fef559 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Going to try to terminate instance {{(pid=118122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:17:05.709704 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-64d656ac-6cb6-430b-86d8-e88979fef559 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 204 len: 0 microversion: 2.1 time: 0.217777 Jul 26 17:17:05.712916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 210/483] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:17:05 2022] DELETE /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 17:17:05.725450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6c60fdb7-f368-4463-8f48-287303c0bd80 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:05.726937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6c60fdb7-f368-4463-8f48-287303c0bd80 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:05.743166 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c60fdb7-f368-4463-8f48-287303c0bd80 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:05.743994 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c60fdb7-f368-4463-8f48-287303c0bd80 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:05.745381 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c60fdb7-f368-4463-8f48-287303c0bd80 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:05.746241 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c60fdb7-f368-4463-8f48-287303c0bd80 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:05.998579 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6c60fdb7-f368-4463-8f48-287303c0bd80 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:06.010365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6c60fdb7-f368-4463-8f48-287303c0bd80 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1681 microversion: 2.1 time: 0.291805 Jul 26 17:17:06.012458 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 274/484] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:05 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1681 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:06.328541 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d73d063e-7cca-41ec-a3db-97eb6a182a0a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:06.332907 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d73d063e-7cca-41ec-a3db-97eb6a182a0a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:06.359250 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d73d063e-7cca-41ec-a3db-97eb6a182a0a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:06.381698 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d73d063e-7cca-41ec-a3db-97eb6a182a0a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:06.385212 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d73d063e-7cca-41ec-a3db-97eb6a182a0a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:06.389918 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d73d063e-7cca-41ec-a3db-97eb6a182a0a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:06.915900 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d73d063e-7cca-41ec-a3db-97eb6a182a0a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:06.927860 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d73d063e-7cca-41ec-a3db-97eb6a182a0a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:06.929479 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d73d063e-7cca-41ec-a3db-97eb6a182a0a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:06.930738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d73d063e-7cca-41ec-a3db-97eb6a182a0a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.610152 Jul 26 17:17:06.940942 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 211/485] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:17:06 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:17:07.039058 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f3f2735a-b75a-4cd4-a436-f895e648d466 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:07.040300 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f3f2735a-b75a-4cd4-a436-f895e648d466 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:07.052175 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3f2735a-b75a-4cd4-a436-f895e648d466 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:07.052739 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3f2735a-b75a-4cd4-a436-f895e648d466 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:07.054083 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3f2735a-b75a-4cd4-a436-f895e648d466 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:07.054609 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3f2735a-b75a-4cd4-a436-f895e648d466 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:07.057742 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:07.243665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f3f2735a-b75a-4cd4-a436-f895e648d466 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:07.252693 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f3f2735a-b75a-4cd4-a436-f895e648d466 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1681 microversion: 2.1 time: 0.221094 Jul 26 17:17:07.270489 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 275/486] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:07 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:07.470958 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7a1420d5-c305-4b70-ad46-c6a840daa242 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Action: 'create', calling method: .version_select at 0x7f6ca96298b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-391504489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ6nq+/Lo0FOM1NzGRLJoHlQCLrFgwDQYztdUNNuCwArU4NQmN0W+kO8JIpRAwjLojmuSU9NOoGILKuNe51RzqVK2VnSNCGgY0rnnadzccYv+Rt7WD3WDgmto9U5wfMjQ=="}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:07.502772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-7a1420d5-c305-4b70-ad46-c6a840daa242 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Getting quotas for project 0a543d5eb6ef45569e57965779e4753e. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:17:07.506652 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-7a1420d5-c305-4b70-ad46-c6a840daa242 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Getting quotas for user d84cca5fc64f46109e9e62394da12437 and project 0a543d5eb6ef45569e57965779e4753e. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:17:07.533894 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7a1420d5-c305-4b70-ad46-c6a840daa242 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.376518 Jul 26 17:17:07.534435 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 212/487] 10.222.0.48 () {60 vars in 1159 bytes} [Tue Jul 26 17:17:07 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:17:07.955915 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6514667d-f92a-4ab9-9fcd-bd7a856bfc9f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:07.956682 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6514667d-f92a-4ab9-9fcd-bd7a856bfc9f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:07.963621 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6514667d-f92a-4ab9-9fcd-bd7a856bfc9f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:07.964137 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6514667d-f92a-4ab9-9fcd-bd7a856bfc9f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:07.966333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6514667d-f92a-4ab9-9fcd-bd7a856bfc9f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:07.967209 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6514667d-f92a-4ab9-9fcd-bd7a856bfc9f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:08.153173 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6514667d-f92a-4ab9-9fcd-bd7a856bfc9f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:08.173335 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6514667d-f92a-4ab9-9fcd-bd7a856bfc9f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:08.175135 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6514667d-f92a-4ab9-9fcd-bd7a856bfc9f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:08.176452 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6514667d-f92a-4ab9-9fcd-bd7a856bfc9f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.224654 Jul 26 17:17:08.188992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 276/488] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:17:07 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:17:08.274768 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-aea2fc27-448b-44b1-8da8-0a45b3fc543d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:08.276642 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-aea2fc27-448b-44b1-8da8-0a45b3fc543d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:08.287128 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aea2fc27-448b-44b1-8da8-0a45b3fc543d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:08.287600 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aea2fc27-448b-44b1-8da8-0a45b3fc543d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:08.289247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aea2fc27-448b-44b1-8da8-0a45b3fc543d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:08.289985 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aea2fc27-448b-44b1-8da8-0a45b3fc543d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:08.521529 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-aea2fc27-448b-44b1-8da8-0a45b3fc543d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:08.524135 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:08.545570 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-aea2fc27-448b-44b1-8da8-0a45b3fc543d tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1681 microversion: 2.1 time: 0.264429 Jul 26 17:17:08.551365 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 213/489] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:08 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:08.688255 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-690595233", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "networks": [{"uuid": "23192039-2da3-4605-a273-90ee307665e7"}]}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:08.791116 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] validate_networks() for [('23192039-2da3-4605-a273-90ee307665e7', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:17:09.207068 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-38af4a7b-5b75-4657-874e-b5b86da084c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:09.208164 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-38af4a7b-5b75-4657-874e-b5b86da084c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:09.219311 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-38af4a7b-5b75-4657-874e-b5b86da084c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:09.220295 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-38af4a7b-5b75-4657-874e-b5b86da084c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:09.221129 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-38af4a7b-5b75-4657-874e-b5b86da084c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:09.221731 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-38af4a7b-5b75-4657-874e-b5b86da084c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:09.299689 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:17:09.300477 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:17:09.300682 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:17:09.301028 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:17:09.301445 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:17:09.317827 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:09.318288 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:09.319207 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:09.322642 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:09.355775 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Getting quotas for project d379bf9c35444978b63c8a5a1e337928. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:17:09.360820 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Getting quotas for user 9d951f022d244c348e045966c33d5663 and project d379bf9c35444978b63c8a5a1e337928. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:17:09.374912 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:17:09.377550 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:17:09.439904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-98a84c02-1842-473f-adb7-082d6091b029 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755938 Jul 26 17:17:09.440561 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 277/490] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:17:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:17:09.453155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3316a222-60f6-47ab-be55-5d6c23919320 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:09.454288 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3316a222-60f6-47ab-be55-5d6c23919320 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:09.463926 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-38af4a7b-5b75-4657-874e-b5b86da084c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:09.489715 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-38af4a7b-5b75-4657-874e-b5b86da084c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:09.495252 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-38af4a7b-5b75-4657-874e-b5b86da084c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:09.499175 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-38af4a7b-5b75-4657-874e-b5b86da084c0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.299744 Jul 26 17:17:09.500381 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 214/491] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:17:09 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:17:09.571835 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3316a222-60f6-47ab-be55-5d6c23919320 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:09.576331 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ac1526d7-b75d-4850-a1ab-0d7aa10c1547 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:09.577608 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ac1526d7-b75d-4850-a1ab-0d7aa10c1547 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:09.582763 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3316a222-60f6-47ab-be55-5d6c23919320 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1218 microversion: 2.1 time: 0.133807 Jul 26 17:17:09.589017 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 278/492] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:09 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:09.597442 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ac1526d7-b75d-4850-a1ab-0d7aa10c1547 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:09.597912 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ac1526d7-b75d-4850-a1ab-0d7aa10c1547 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:09.598741 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ac1526d7-b75d-4850-a1ab-0d7aa10c1547 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:09.599183 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ac1526d7-b75d-4850-a1ab-0d7aa10c1547 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:09.929148 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ac1526d7-b75d-4850-a1ab-0d7aa10c1547 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:09.948330 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ac1526d7-b75d-4850-a1ab-0d7aa10c1547 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1681 microversion: 2.1 time: 0.379270 Jul 26 17:17:09.948761 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 215/493] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:09 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1681 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:10.113662 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fbeab9bf-d1f6-4069-bf83-3c0fac559d2a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:10.114203 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fbeab9bf-d1f6-4069-bf83-3c0fac559d2a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:10.125227 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbeab9bf-d1f6-4069-bf83-3c0fac559d2a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:10.126343 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbeab9bf-d1f6-4069-bf83-3c0fac559d2a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:10.127516 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbeab9bf-d1f6-4069-bf83-3c0fac559d2a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:10.128195 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbeab9bf-d1f6-4069-bf83-3c0fac559d2a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:10.386976 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-fbeab9bf-d1f6-4069-bf83-3c0fac559d2a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lazy-loading 'services' on Instance uuid e2799ba4-de59-4849-85e7-d0aaf12578e1 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:17:10.523775 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-53edb5d2-d7c1-4908-85b3-e1bc33acb9fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:10.524500 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-53edb5d2-d7c1-4908-85b3-e1bc33acb9fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:10.553429 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-53edb5d2-d7c1-4908-85b3-e1bc33acb9fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:10.553894 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-53edb5d2-d7c1-4908-85b3-e1bc33acb9fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:10.554705 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-53edb5d2-d7c1-4908-85b3-e1bc33acb9fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:10.555147 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-53edb5d2-d7c1-4908-85b3-e1bc33acb9fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:10.636374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fbeab9bf-d1f6-4069-bf83-3c0fac559d2a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/os-volume_attachments/b99c35a5-1f4e-4fd2-9cf0-c9b421e42e49" status: 202 len: 0 microversion: 2.1 time: 0.534218 Jul 26 17:17:10.638301 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 279/494] 10.222.0.48 () {58 vars in 1416 bytes} [Tue Jul 26 17:17:10 2022] DELETE /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/os-volume_attachments/b99c35a5-1f4e-4fd2-9cf0-c9b421e42e49 => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:17:10.673177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0a33434d-7432-4ebc-b0fd-d67732efafd1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:10.680025 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0a33434d-7432-4ebc-b0fd-d67732efafd1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:10.712061 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a33434d-7432-4ebc-b0fd-d67732efafd1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:10.712535 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a33434d-7432-4ebc-b0fd-d67732efafd1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:10.719084 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a33434d-7432-4ebc-b0fd-d67732efafd1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:10.719568 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a33434d-7432-4ebc-b0fd-d67732efafd1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:10.942814 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0a33434d-7432-4ebc-b0fd-d67732efafd1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:10.966433 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0a33434d-7432-4ebc-b0fd-d67732efafd1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1214 microversion: 2.1 time: 0.326226 Jul 26 17:17:10.967589 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 280/495] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:10 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1214 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:10.985755 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9577b5e9-47da-4ca0-9c11-49762d2ecccb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:10.986369 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9577b5e9-47da-4ca0-9c11-49762d2ecccb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:10.998761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9577b5e9-47da-4ca0-9c11-49762d2ecccb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:11.005350 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9577b5e9-47da-4ca0-9c11-49762d2ecccb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:11.006375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9577b5e9-47da-4ca0-9c11-49762d2ecccb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:11.009498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9577b5e9-47da-4ca0-9c11-49762d2ecccb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:11.179902 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-53edb5d2-d7c1-4908-85b3-e1bc33acb9fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:11.203520 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-53edb5d2-d7c1-4908-85b3-e1bc33acb9fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:11.205667 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-53edb5d2-d7c1-4908-85b3-e1bc33acb9fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:11.207037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-53edb5d2-d7c1-4908-85b3-e1bc33acb9fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1810 microversion: 2.20 time: 0.688035 Jul 26 17:17:11.221830 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 216/496] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:17:10 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1810 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:17:11.256277 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9577b5e9-47da-4ca0-9c11-49762d2ecccb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:11.275994 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9577b5e9-47da-4ca0-9c11-49762d2ecccb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1681 microversion: 2.1 time: 0.300855 Jul 26 17:17:11.278056 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 281/497] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:10 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1681 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:12.018683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2be5ce1b-9b26-43ea-ad49-bcde3e0c157d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:12.019670 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2be5ce1b-9b26-43ea-ad49-bcde3e0c157d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:12.028179 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2be5ce1b-9b26-43ea-ad49-bcde3e0c157d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:12.028808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2be5ce1b-9b26-43ea-ad49-bcde3e0c157d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:12.030024 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2be5ce1b-9b26-43ea-ad49-bcde3e0c157d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:12.030481 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2be5ce1b-9b26-43ea-ad49-bcde3e0c157d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:12.234511 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79354efc-09bb-4a87-92df-83c0e30a53c2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:12.238187 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79354efc-09bb-4a87-92df-83c0e30a53c2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:12.261417 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79354efc-09bb-4a87-92df-83c0e30a53c2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:12.262366 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79354efc-09bb-4a87-92df-83c0e30a53c2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:12.263473 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79354efc-09bb-4a87-92df-83c0e30a53c2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:12.266545 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79354efc-09bb-4a87-92df-83c0e30a53c2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:12.269085 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-2be5ce1b-9b26-43ea-ad49-bcde3e0c157d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:12.277969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2be5ce1b-9b26-43ea-ad49-bcde3e0c157d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1278 microversion: 2.1 time: 0.270693 Jul 26 17:17:12.287977 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 217/498] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:12 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:12.312524 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d45d5eec-1ae9-4042-ac5b-43ee5efd8ac3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:12.313662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d45d5eec-1ae9-4042-ac5b-43ee5efd8ac3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:12.325985 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d45d5eec-1ae9-4042-ac5b-43ee5efd8ac3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:12.326727 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d45d5eec-1ae9-4042-ac5b-43ee5efd8ac3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:12.327802 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d45d5eec-1ae9-4042-ac5b-43ee5efd8ac3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:12.329012 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d45d5eec-1ae9-4042-ac5b-43ee5efd8ac3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:12.478407 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d45d5eec-1ae9-4042-ac5b-43ee5efd8ac3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:12.503216 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d45d5eec-1ae9-4042-ac5b-43ee5efd8ac3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 200 len: 1613 microversion: 2.1 time: 0.193166 Jul 26 17:17:12.504205 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 218/499] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:12 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 1613 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:12.631768 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-ff9e14f6-93fb-4909-9e52-4ac042c254f1 req-83f7a5d9-e650-4548-93f5-00e112291ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db19722e-e060-4323-8b57-179687e601d6", "name": "network-vif-deleted", "tag": "b046591b-0a3b-41bc-908a-5b12dbcf6b04"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:12.647314 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-ff9e14f6-93fb-4909-9e52-4ac042c254f1 req-83f7a5d9-e650-4548-93f5-00e112291ff6 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:12.648052 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-ff9e14f6-93fb-4909-9e52-4ac042c254f1 req-83f7a5d9-e650-4548-93f5-00e112291ff6 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:12.671387 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-ff9e14f6-93fb-4909-9e52-4ac042c254f1 req-83f7a5d9-e650-4548-93f5-00e112291ff6 service nova] Creating event network-vif-deleted:b046591b-0a3b-41bc-908a-5b12dbcf6b04 for instance db19722e-e060-4323-8b57-179687e601d6 on hv-cinder-83538 Jul 26 17:17:12.682741 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-ff9e14f6-93fb-4909-9e52-4ac042c254f1 req-83f7a5d9-e650-4548-93f5-00e112291ff6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055164 Jul 26 17:17:12.688000 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 219/500] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:17:12.726674 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79354efc-09bb-4a87-92df-83c0e30a53c2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:12.752266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79354efc-09bb-4a87-92df-83c0e30a53c2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:12.758529 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79354efc-09bb-4a87-92df-83c0e30a53c2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:12.765239 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79354efc-09bb-4a87-92df-83c0e30a53c2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1797 microversion: 2.20 time: 0.536580 Jul 26 17:17:12.770222 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 282/501] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:17:12 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1797 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:17:13.145018 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4f2db27f-9c4e-46bf-b622-14b4bfacded7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:13.185815 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f2db27f-9c4e-46bf-b622-14b4bfacded7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:13.186281 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f2db27f-9c4e-46bf-b622-14b4bfacded7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:13.311851 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5bd6fdd7-698a-455a-b59b-8f53ce5e34cc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:13.313253 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5bd6fdd7-698a-455a-b59b-8f53ce5e34cc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:13.327041 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bd6fdd7-698a-455a-b59b-8f53ce5e34cc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:13.333191 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bd6fdd7-698a-455a-b59b-8f53ce5e34cc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:13.334337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bd6fdd7-698a-455a-b59b-8f53ce5e34cc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:13.334948 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bd6fdd7-698a-455a-b59b-8f53ce5e34cc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:13.392300 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4f2db27f-9c4e-46bf-b622-14b4bfacded7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Going to try to stop instance {{(pid=118122) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 17:17:13.457168 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4f2db27f-9c4e-46bf-b622-14b4bfacded7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "POST /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/action" status: 202 len: 0 microversion: 2.1 time: 0.319976 Jul 26 17:17:13.461357 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 220/502] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:17:13 2022] POST /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:17:13.472317 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7b7ad034-4dac-420b-bdc8-59bfffffa3cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:13.478037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7b7ad034-4dac-420b-bdc8-59bfffffa3cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:13.488864 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7b7ad034-4dac-420b-bdc8-59bfffffa3cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:13.493745 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7b7ad034-4dac-420b-bdc8-59bfffffa3cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:13.494860 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7b7ad034-4dac-420b-bdc8-59bfffffa3cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:13.495460 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7b7ad034-4dac-420b-bdc8-59bfffffa3cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:13.706057 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5bd6fdd7-698a-455a-b59b-8f53ce5e34cc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:13.726386 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5bd6fdd7-698a-455a-b59b-8f53ce5e34cc tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1276 microversion: 2.1 time: 0.416273 Jul 26 17:17:13.732237 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 283/503] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:13 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1276 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:13.751405 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-359d637f-10fd-4f25-a439-8aeefc7a56db tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:13.758558 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-359d637f-10fd-4f25-a439-8aeefc7a56db tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:13.800009 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-359d637f-10fd-4f25-a439-8aeefc7a56db tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:13.802199 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-359d637f-10fd-4f25-a439-8aeefc7a56db tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:13.805838 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-359d637f-10fd-4f25-a439-8aeefc7a56db tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:13.806308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-359d637f-10fd-4f25-a439-8aeefc7a56db tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:13.854198 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-359d637f-10fd-4f25-a439-8aeefc7a56db tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-359d637f-10fd-4f25-a439-8aeefc7a56db tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 HTTP/1.1 Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:17:13.857904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:17:13.859554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:17:13.859554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:17:13.859554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:17:13.859554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:17:13.859554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:17:13.859554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:17:13.859554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:17:13.859554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:17:13.859554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:17:13.859554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:17:13.859554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:17:13.859554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': 'db19722e-e060-4323-8b57-179687e601d6'} Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:17:13.860407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:17:13.861803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:17:13.864633 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-359d637f-10fd-4f25-a439-8aeefc7a56db tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 404 to user: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:17:13.865934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-359d637f-10fd-4f25-a439-8aeefc7a56db tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 404 len: 111 microversion: 2.1 time: 0.129887 Jul 26 17:17:13.871479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 284/504] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:13 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:17:13.877403 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-da783f2b-c6bd-4620-b75a-b4c92ce7cfef tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '.version_select at 0x7f6ca8a5daf0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:13.913352 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-da783f2b-c6bd-4620-b75a-b4c92ce7cfef tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-630634567" status: 202 len: 0 microversion: 2.1 time: 0.040050 Jul 26 17:17:13.917542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 285/505] 10.222.0.48 () {58 vars in 1218 bytes} [Tue Jul 26 17:17:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-630634567 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:17:13.956535 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7b7ad034-4dac-420b-bdc8-59bfffffa3cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:13.982881 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7b7ad034-4dac-420b-bdc8-59bfffffa3cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1677 microversion: 2.1 time: 0.519798 Jul 26 17:17:13.987357 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 221/506] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:13 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1677 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:14.768632 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4a8d85e4-195f-4c06-b4ec-2644d3c9b513 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:14.770048 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4a8d85e4-195f-4c06-b4ec-2644d3c9b513 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:14.790234 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4a8d85e4-195f-4c06-b4ec-2644d3c9b513 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:14.792896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4a8d85e4-195f-4c06-b4ec-2644d3c9b513 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:14.795353 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4a8d85e4-195f-4c06-b4ec-2644d3c9b513 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:14.796215 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4a8d85e4-195f-4c06-b4ec-2644d3c9b513 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:15.021745 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0a59b5aa-020b-4f7f-9edf-496fd0646eda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:15.026447 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0a59b5aa-020b-4f7f-9edf-496fd0646eda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:15.034664 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0a59b5aa-020b-4f7f-9edf-496fd0646eda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:15.035381 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0a59b5aa-020b-4f7f-9edf-496fd0646eda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:15.036437 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0a59b5aa-020b-4f7f-9edf-496fd0646eda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:15.037064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0a59b5aa-020b-4f7f-9edf-496fd0646eda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:15.270158 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4a8d85e4-195f-4c06-b4ec-2644d3c9b513 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:15.309429 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4a8d85e4-195f-4c06-b4ec-2644d3c9b513 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1318 microversion: 2.1 time: 0.543801 Jul 26 17:17:15.313130 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 286/507] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:14 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:15.538906 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0a59b5aa-020b-4f7f-9edf-496fd0646eda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:15.567561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0a59b5aa-020b-4f7f-9edf-496fd0646eda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1677 microversion: 2.1 time: 0.550017 Jul 26 17:17:15.586221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 222/508] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:15 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1677 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:15.680171 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1d512bb5-8f46-4c73-8cff-2780b1d1947e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:15.683851 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1d512bb5-8f46-4c73-8cff-2780b1d1947e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:15.703545 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d512bb5-8f46-4c73-8cff-2780b1d1947e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:15.704543 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d512bb5-8f46-4c73-8cff-2780b1d1947e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:15.706463 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d512bb5-8f46-4c73-8cff-2780b1d1947e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:15.707411 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d512bb5-8f46-4c73-8cff-2780b1d1947e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:15.900495 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-1d512bb5-8f46-4c73-8cff-2780b1d1947e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lazy-loading 'services' on Instance uuid 20195acb-7356-4e87-a2a8-1ee88cd3e3ea {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:17:16.080095 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1d512bb5-8f46-4c73-8cff-2780b1d1947e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/os-volume_attachments/ae9589ee-c4be-487e-bb4c-65101ac5d0b3" status: 202 len: 0 microversion: 2.1 time: 0.406259 Jul 26 17:17:16.081825 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 287/509] 10.222.0.48 () {58 vars in 1416 bytes} [Tue Jul 26 17:17:15 2022] DELETE /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/os-volume_attachments/ae9589ee-c4be-487e-bb4c-65101ac5d0b3 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:17:16.094338 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d6e9a102-a290-447b-a351-6ab7bedb4fa4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:16.103615 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-5c3d68b3-deaf-4336-b35b-ff7296340a10 req-dea29769-c54c-4554-a3ba-86934d301526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d8afff-584e-4332-bab7-9b4e4b676dd0", "tag": "fc687e56-c81d-4933-8a74-eb1550ca516f"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:16.108130 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d6e9a102-a290-447b-a351-6ab7bedb4fa4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:16.128160 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6e9a102-a290-447b-a351-6ab7bedb4fa4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:16.129770 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6e9a102-a290-447b-a351-6ab7bedb4fa4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:16.133245 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6e9a102-a290-447b-a351-6ab7bedb4fa4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:16.137426 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6e9a102-a290-447b-a351-6ab7bedb4fa4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:16.152450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-5c3d68b3-deaf-4336-b35b-ff7296340a10 req-dea29769-c54c-4554-a3ba-86934d301526 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:16.154189 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-5c3d68b3-deaf-4336-b35b-ff7296340a10 req-dea29769-c54c-4554-a3ba-86934d301526 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:16.197419 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-5c3d68b3-deaf-4336-b35b-ff7296340a10 req-dea29769-c54c-4554-a3ba-86934d301526 service nova] Creating event network-changed:fc687e56-c81d-4933-8a74-eb1550ca516f for instance 87d8afff-584e-4332-bab7-9b4e4b676dd0 on hv-cinder-83538 Jul 26 17:17:16.220357 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-5c3d68b3-deaf-4336-b35b-ff7296340a10 req-dea29769-c54c-4554-a3ba-86934d301526 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134892 Jul 26 17:17:16.233096 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 223/510] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:17:16.267270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d6e9a102-a290-447b-a351-6ab7bedb4fa4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178399 Jul 26 17:17:16.268259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 288/511] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:17:16 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:17:16.335470 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-99b6227e-db91-4a4b-b8f7-64a0c4acf5f2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:16.337093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-99b6227e-db91-4a4b-b8f7-64a0c4acf5f2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:16.350490 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-99b6227e-db91-4a4b-b8f7-64a0c4acf5f2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:16.351305 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-99b6227e-db91-4a4b-b8f7-64a0c4acf5f2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:16.352738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-99b6227e-db91-4a4b-b8f7-64a0c4acf5f2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:16.353592 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-99b6227e-db91-4a4b-b8f7-64a0c4acf5f2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:16.562494 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-99b6227e-db91-4a4b-b8f7-64a0c4acf5f2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:16.572328 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-99b6227e-db91-4a4b-b8f7-64a0c4acf5f2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1318 microversion: 2.1 time: 0.241255 Jul 26 17:17:16.572911 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 224/512] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:16 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:16.648295 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79571c86-a54d-4a96-b892-68a6cfd6ea1b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:16.649750 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79571c86-a54d-4a96-b892-68a6cfd6ea1b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:16.662494 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79571c86-a54d-4a96-b892-68a6cfd6ea1b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:16.662895 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79571c86-a54d-4a96-b892-68a6cfd6ea1b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:16.665992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79571c86-a54d-4a96-b892-68a6cfd6ea1b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:16.667527 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79571c86-a54d-4a96-b892-68a6cfd6ea1b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:17.030385 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79571c86-a54d-4a96-b892-68a6cfd6ea1b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:17.039833 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79571c86-a54d-4a96-b892-68a6cfd6ea1b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1677 microversion: 2.1 time: 0.398946 Jul 26 17:17:17.040802 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 289/513] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:16 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1677 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:17.283931 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f7cc2289-5f18-47ba-baa9-d69508701833 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:17.287135 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-f7cc2289-5f18-47ba-baa9-d69508701833 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:17.297765 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f7cc2289-5f18-47ba-baa9-d69508701833 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:17.298456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f7cc2289-5f18-47ba-baa9-d69508701833 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:17.299416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f7cc2289-5f18-47ba-baa9-d69508701833 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:17.300008 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f7cc2289-5f18-47ba-baa9-d69508701833 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:17.355047 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-f7cc2289-5f18-47ba-baa9-d69508701833 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074390 Jul 26 17:17:17.355047 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 225/514] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:17:17 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:17:17.608661 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-177edc3e-0b00-4200-9f19-35db3e9dbd2a tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:17.609399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-177edc3e-0b00-4200-9f19-35db3e9dbd2a tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:17.616279 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-177edc3e-0b00-4200-9f19-35db3e9dbd2a tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:17.617035 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-177edc3e-0b00-4200-9f19-35db3e9dbd2a tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:17.617886 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-177edc3e-0b00-4200-9f19-35db3e9dbd2a tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:17.618327 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-177edc3e-0b00-4200-9f19-35db3e9dbd2a tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:17.811820 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-177edc3e-0b00-4200-9f19-35db3e9dbd2a tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:17.828712 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-177edc3e-0b00-4200-9f19-35db3e9dbd2a tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1318 microversion: 2.1 time: 0.224093 Jul 26 17:17:17.829715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 290/515] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:17 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:18.080694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0e3ffad4-4fba-4245-9241-785beba00c52 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:18.081530 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0e3ffad4-4fba-4245-9241-785beba00c52 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:18.084075 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=4 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:18.092068 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0e3ffad4-4fba-4245-9241-785beba00c52 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:18.092598 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0e3ffad4-4fba-4245-9241-785beba00c52 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:18.093777 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0e3ffad4-4fba-4245-9241-785beba00c52 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:18.094337 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0e3ffad4-4fba-4245-9241-785beba00c52 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:18.301020 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0e3ffad4-4fba-4245-9241-785beba00c52 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:18.310878 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0e3ffad4-4fba-4245-9241-785beba00c52 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1677 microversion: 2.1 time: 0.236387 Jul 26 17:17:18.311757 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 226/516] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:18 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:18.367775 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e227405a-06f8-4e5c-a6bd-3b6c98a9d6b6 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:18.370849 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e227405a-06f8-4e5c-a6bd-3b6c98a9d6b6 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:18.377795 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e227405a-06f8-4e5c-a6bd-3b6c98a9d6b6 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:18.378268 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e227405a-06f8-4e5c-a6bd-3b6c98a9d6b6 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:18.379052 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e227405a-06f8-4e5c-a6bd-3b6c98a9d6b6 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:18.379487 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e227405a-06f8-4e5c-a6bd-3b6c98a9d6b6 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:18.415037 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e227405a-06f8-4e5c-a6bd-3b6c98a9d6b6 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052149 Jul 26 17:17:18.415722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 291/517] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:17:18 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 17:17:18.484191 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4574c2f4-2a67-4a0d-8eb1-596607214760 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:18.484700 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4574c2f4-2a67-4a0d-8eb1-596607214760 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:18.491170 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4574c2f4-2a67-4a0d-8eb1-596607214760 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:18.491621 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4574c2f4-2a67-4a0d-8eb1-596607214760 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:18.492417 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4574c2f4-2a67-4a0d-8eb1-596607214760 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:18.492856 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4574c2f4-2a67-4a0d-8eb1-596607214760 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:18.545489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4574c2f4-2a67-4a0d-8eb1-596607214760 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Going to try to terminate instance {{(pid=118122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:17:18.676280 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4574c2f4-2a67-4a0d-8eb1-596607214760 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 204 len: 0 microversion: 2.1 time: 0.195088 Jul 26 17:17:18.677427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 227/518] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:17:18 2022] DELETE /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 17:17:18.687026 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2eef8ee3-0138-48c4-85e2-479dc674a0fb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:18.687648 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2eef8ee3-0138-48c4-85e2-479dc674a0fb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:18.694937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2eef8ee3-0138-48c4-85e2-479dc674a0fb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:18.695397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2eef8ee3-0138-48c4-85e2-479dc674a0fb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:18.696499 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2eef8ee3-0138-48c4-85e2-479dc674a0fb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:18.697169 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2eef8ee3-0138-48c4-85e2-479dc674a0fb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:18.862941 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-bb90ed78-c1a5-456a-a829-2116aff929d3 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:18.863925 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-bb90ed78-c1a5-456a-a829-2116aff929d3 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:18.872936 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bb90ed78-c1a5-456a-a829-2116aff929d3 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:18.873785 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bb90ed78-c1a5-456a-a829-2116aff929d3 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:18.874917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bb90ed78-c1a5-456a-a829-2116aff929d3 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:18.875566 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bb90ed78-c1a5-456a-a829-2116aff929d3 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:18.986788 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2eef8ee3-0138-48c4-85e2-479dc674a0fb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:19.007308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2eef8ee3-0138-48c4-85e2-479dc674a0fb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1678 microversion: 2.1 time: 0.324039 Jul 26 17:17:19.008374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 292/519] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:18 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1678 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:19.181817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-bb90ed78-c1a5-456a-a829-2116aff929d3 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:19.195156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-bb90ed78-c1a5-456a-a829-2116aff929d3 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1318 microversion: 2.1 time: 0.336673 Jul 26 17:17:19.195965 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 228/520] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:18 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:19.347173 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-35f27cfb-7d85-4934-8cad-faf554dc1f32 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:19.348201 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-35f27cfb-7d85-4934-8cad-faf554dc1f32 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:19.351723 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:19.362367 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35f27cfb-7d85-4934-8cad-faf554dc1f32 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:19.363234 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35f27cfb-7d85-4934-8cad-faf554dc1f32 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:19.363934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35f27cfb-7d85-4934-8cad-faf554dc1f32 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:19.364122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35f27cfb-7d85-4934-8cad-faf554dc1f32 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:19.578151 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=8 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:19.611878 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-35f27cfb-7d85-4934-8cad-faf554dc1f32 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:19.614720 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:19.627259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-35f27cfb-7d85-4934-8cad-faf554dc1f32 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1677 microversion: 2.1 time: 0.284766 Jul 26 17:17:19.628126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 293/521] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:19 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1677 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:20.047250 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-03a8d88e-edd0-4e4a-b843-dd11b57265e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:20.048629 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-03a8d88e-edd0-4e4a-b843-dd11b57265e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:20.055611 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-03a8d88e-edd0-4e4a-b843-dd11b57265e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:20.056053 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-03a8d88e-edd0-4e4a-b843-dd11b57265e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:20.057063 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-03a8d88e-edd0-4e4a-b843-dd11b57265e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:20.057655 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-03a8d88e-edd0-4e4a-b843-dd11b57265e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:20.084640 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:20.228442 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0fdeaf31-683b-4945-a880-6f14e947d716 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:20.233445 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0fdeaf31-683b-4945-a880-6f14e947d716 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:20.251977 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fdeaf31-683b-4945-a880-6f14e947d716 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:20.253522 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fdeaf31-683b-4945-a880-6f14e947d716 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:20.255975 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fdeaf31-683b-4945-a880-6f14e947d716 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:20.256811 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fdeaf31-683b-4945-a880-6f14e947d716 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:20.461451 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-03a8d88e-edd0-4e4a-b843-dd11b57265e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:20.477182 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-03a8d88e-edd0-4e4a-b843-dd11b57265e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1678 microversion: 2.1 time: 0.435925 Jul 26 17:17:20.479037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 229/522] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:20 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1678 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:20.604355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0fdeaf31-683b-4945-a880-6f14e947d716 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:20.621663 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0fdeaf31-683b-4945-a880-6f14e947d716 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1318 microversion: 2.1 time: 0.402810 Jul 26 17:17:20.637663 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 294/523] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:20 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:20.659264 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-69a0b756-f680-4309-bcd4-9001e1498c82 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:20.660799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-69a0b756-f680-4309-bcd4-9001e1498c82 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:20.685947 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-69a0b756-f680-4309-bcd4-9001e1498c82 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:20.687366 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-69a0b756-f680-4309-bcd4-9001e1498c82 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:20.689280 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-69a0b756-f680-4309-bcd4-9001e1498c82 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:20.690442 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-69a0b756-f680-4309-bcd4-9001e1498c82 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:21.417489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-69a0b756-f680-4309-bcd4-9001e1498c82 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:21.436942 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-69a0b756-f680-4309-bcd4-9001e1498c82 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1677 microversion: 2.1 time: 0.785590 Jul 26 17:17:21.438599 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 230/524] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:20 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1677 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:21.503398 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f32f82be-a4ca-4025-b243-b0e79c709ba8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:21.504427 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f32f82be-a4ca-4025-b243-b0e79c709ba8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:21.514641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f32f82be-a4ca-4025-b243-b0e79c709ba8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:21.515580 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f32f82be-a4ca-4025-b243-b0e79c709ba8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:21.516599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f32f82be-a4ca-4025-b243-b0e79c709ba8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:21.517223 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f32f82be-a4ca-4025-b243-b0e79c709ba8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:21.663884 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ed6381af-01a4-49cd-ba34-6297a55e9924 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:21.665908 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ed6381af-01a4-49cd-ba34-6297a55e9924 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:21.690912 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ed6381af-01a4-49cd-ba34-6297a55e9924 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:21.692134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ed6381af-01a4-49cd-ba34-6297a55e9924 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:21.693890 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ed6381af-01a4-49cd-ba34-6297a55e9924 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:21.695088 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ed6381af-01a4-49cd-ba34-6297a55e9924 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:21.753614 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f32f82be-a4ca-4025-b243-b0e79c709ba8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:21.771375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f32f82be-a4ca-4025-b243-b0e79c709ba8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1678 microversion: 2.1 time: 0.272328 Jul 26 17:17:21.778383 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 295/525] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:21 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1678 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:22.429906 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ed6381af-01a4-49cd-ba34-6297a55e9924 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:22.447241 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ed6381af-01a4-49cd-ba34-6297a55e9924 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1318 microversion: 2.1 time: 0.790449 Jul 26 17:17:22.449212 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 231/526] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:21 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1318 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:22.485795 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a0f1964e-a4d3-4619-b9f5-e6f1a3861d60 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:22.486928 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a0f1964e-a4d3-4619-b9f5-e6f1a3861d60 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:22.498923 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0f1964e-a4d3-4619-b9f5-e6f1a3861d60 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:22.500219 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0f1964e-a4d3-4619-b9f5-e6f1a3861d60 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:22.502120 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0f1964e-a4d3-4619-b9f5-e6f1a3861d60 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:22.503261 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0f1964e-a4d3-4619-b9f5-e6f1a3861d60 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:22.758819 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0f1964e-a4d3-4619-b9f5-e6f1a3861d60 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:22.774182 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a0f1964e-a4d3-4619-b9f5-e6f1a3861d60 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1677 microversion: 2.1 time: 0.306402 Jul 26 17:17:22.781492 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 296/527] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:22 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1677 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:22.805579 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-43c251ad-213c-45c2-b6b0-5de4dad6aee7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:22.806426 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-43c251ad-213c-45c2-b6b0-5de4dad6aee7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:22.815900 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-43c251ad-213c-45c2-b6b0-5de4dad6aee7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:22.816699 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-43c251ad-213c-45c2-b6b0-5de4dad6aee7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:22.817550 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-43c251ad-213c-45c2-b6b0-5de4dad6aee7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:22.817994 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-43c251ad-213c-45c2-b6b0-5de4dad6aee7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:22.988802 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-b9dcfb74-1d5e-4170-a9d3-a9abd4328f94 req-bf075e40-3ff4-4d62-9364-0f4e02b0763a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d8afff-584e-4332-bab7-9b4e4b676dd0", "name": "network-vif-plugged", "status": "completed", "tag": "fc687e56-c81d-4933-8a74-eb1550ca516f"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:23.013376 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-b9dcfb74-1d5e-4170-a9d3-a9abd4328f94 req-bf075e40-3ff4-4d62-9364-0f4e02b0763a service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:23.014797 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-b9dcfb74-1d5e-4170-a9d3-a9abd4328f94 req-bf075e40-3ff4-4d62-9364-0f4e02b0763a service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:23.033446 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-b9dcfb74-1d5e-4170-a9d3-a9abd4328f94 req-bf075e40-3ff4-4d62-9364-0f4e02b0763a service nova] Creating event network-vif-plugged:fc687e56-c81d-4933-8a74-eb1550ca516f for instance 87d8afff-584e-4332-bab7-9b4e4b676dd0 on hv-cinder-83538 Jul 26 17:17:23.041177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-b9dcfb74-1d5e-4170-a9d3-a9abd4328f94 req-bf075e40-3ff4-4d62-9364-0f4e02b0763a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056777 Jul 26 17:17:23.044835 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 297/528] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:17:23.256128 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-43c251ad-213c-45c2-b6b0-5de4dad6aee7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:23.277433 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-43c251ad-213c-45c2-b6b0-5de4dad6aee7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1678 microversion: 2.1 time: 0.475042 Jul 26 17:17:23.278737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 232/529] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:22 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1678 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:23.477844 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3e49a62d-92cd-4247-81bd-058eae44097e tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:23.479588 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3e49a62d-92cd-4247-81bd-058eae44097e tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:23.508301 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e49a62d-92cd-4247-81bd-058eae44097e tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:23.510741 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e49a62d-92cd-4247-81bd-058eae44097e tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:23.513541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e49a62d-92cd-4247-81bd-058eae44097e tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:23.514864 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e49a62d-92cd-4247-81bd-058eae44097e tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:23.794809 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3e49a62d-92cd-4247-81bd-058eae44097e tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:23.802316 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1c2b4cf4-2ca9-4f8e-9e39-d2ac7dc8243b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:23.803670 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1c2b4cf4-2ca9-4f8e-9e39-d2ac7dc8243b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:23.813298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:23.814069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3e49a62d-92cd-4247-81bd-058eae44097e tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1318 microversion: 2.1 time: 0.345533 Jul 26 17:17:23.817336 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c2b4cf4-2ca9-4f8e-9e39-d2ac7dc8243b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:23.818619 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c2b4cf4-2ca9-4f8e-9e39-d2ac7dc8243b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:23.820357 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c2b4cf4-2ca9-4f8e-9e39-d2ac7dc8243b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:23.821792 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c2b4cf4-2ca9-4f8e-9e39-d2ac7dc8243b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:23.830063 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 298/530] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:23 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:24.030398 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-aee31f39-e867-404d-a962-cc502d1c100e req-f21469cc-38c9-4ec2-81d9-021a8eb3c0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20195acb-7356-4e87-a2a8-1ee88cd3e3ea", "name": "network-vif-deleted", "tag": "e663e87f-330a-4fa0-96d9-10ce8af7ff1a"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:24.042697 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-aee31f39-e867-404d-a962-cc502d1c100e req-f21469cc-38c9-4ec2-81d9-021a8eb3c0bc service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:24.043490 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-aee31f39-e867-404d-a962-cc502d1c100e req-f21469cc-38c9-4ec2-81d9-021a8eb3c0bc service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:24.118719 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1c2b4cf4-2ca9-4f8e-9e39-d2ac7dc8243b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:24.127018 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-aee31f39-e867-404d-a962-cc502d1c100e req-f21469cc-38c9-4ec2-81d9-021a8eb3c0bc service nova] Creating event network-vif-deleted:e663e87f-330a-4fa0-96d9-10ce8af7ff1a for instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea on hv-cinder-83538 Jul 26 17:17:24.129475 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1c2b4cf4-2ca9-4f8e-9e39-d2ac7dc8243b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1677 microversion: 2.1 time: 0.334065 Jul 26 17:17:24.130262 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 233/531] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:23 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1677 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:24.144120 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-aee31f39-e867-404d-a962-cc502d1c100e req-f21469cc-38c9-4ec2-81d9-021a8eb3c0bc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118202 Jul 26 17:17:24.146386 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 299/532] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:17:24.160852 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-82ad1e6a-9932-4709-9be5-892456ae7104 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aca78baa-aea6-4863-b4f5-7b62d8825346"}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:24.163967 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-82ad1e6a-9932-4709-9be5-892456ae7104 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:24.172122 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-82ad1e6a-9932-4709-9be5-892456ae7104 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:24.172580 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-82ad1e6a-9932-4709-9be5-892456ae7104 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:24.174095 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-82ad1e6a-9932-4709-9be5-892456ae7104 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:24.174726 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-82ad1e6a-9932-4709-9be5-892456ae7104 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:24.304724 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8fa41303-5351-489f-a4c1-f1332a31d4ee tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:24.305925 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8fa41303-5351-489f-a4c1-f1332a31d4ee tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:24.318132 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:24.334186 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8fa41303-5351-489f-a4c1-f1332a31d4ee tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:24.340794 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8fa41303-5351-489f-a4c1-f1332a31d4ee tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:24.342190 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8fa41303-5351-489f-a4c1-f1332a31d4ee tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:24.344663 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8fa41303-5351-489f-a4c1-f1332a31d4ee tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:24.477562 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8fa41303-5351-489f-a4c1-f1332a31d4ee tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:24.511073 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8fa41303-5351-489f-a4c1-f1332a31d4ee tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1612 microversion: 2.1 time: 0.210116 Jul 26 17:17:24.514303 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 300/533] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:24 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1612 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:24.756429 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-82ad1e6a-9932-4709-9be5-892456ae7104 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "POST /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.599465 Jul 26 17:17:24.757690 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 234/534] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:17:24 2022] POST /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments => generated 194 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:17:24.850978 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f5824d02-4e33-4805-a259-d2352312c158 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:24.851718 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f5824d02-4e33-4805-a259-d2352312c158 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:24.866472 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5824d02-4e33-4805-a259-d2352312c158 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:24.867026 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5824d02-4e33-4805-a259-d2352312c158 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:24.867898 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5824d02-4e33-4805-a259-d2352312c158 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:24.868426 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5824d02-4e33-4805-a259-d2352312c158 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:25.158561 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-dfb4b3ea-746b-4d53-a137-343cf0ab3836 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:25.161755 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-dfb4b3ea-746b-4d53-a137-343cf0ab3836 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:25.174685 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dfb4b3ea-746b-4d53-a137-343cf0ab3836 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:25.175993 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dfb4b3ea-746b-4d53-a137-343cf0ab3836 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:25.177223 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dfb4b3ea-746b-4d53-a137-343cf0ab3836 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:25.179021 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dfb4b3ea-746b-4d53-a137-343cf0ab3836 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:25.193894 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f5824d02-4e33-4805-a259-d2352312c158 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:25.207103 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f5824d02-4e33-4805-a259-d2352312c158 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1318 microversion: 2.1 time: 0.359814 Jul 26 17:17:25.207716 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 301/535] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:24 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:25.425122 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-dfb4b3ea-746b-4d53-a137-343cf0ab3836 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:25.441394 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-dfb4b3ea-746b-4d53-a137-343cf0ab3836 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1677 microversion: 2.1 time: 0.292602 Jul 26 17:17:25.442613 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 235/536] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:25 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1677 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:25.538909 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5d768104-73fd-4a92-9771-a53bc98b4e91 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:25.541070 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5d768104-73fd-4a92-9771-a53bc98b4e91 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:25.550338 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d768104-73fd-4a92-9771-a53bc98b4e91 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:25.551131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d768104-73fd-4a92-9771-a53bc98b4e91 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:25.552078 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d768104-73fd-4a92-9771-a53bc98b4e91 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:25.552659 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d768104-73fd-4a92-9771-a53bc98b4e91 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:25.605046 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d768104-73fd-4a92-9771-a53bc98b4e91 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:25.606315 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d768104-73fd-4a92-9771-a53bc98b4e91 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:25.606943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-5d768104-73fd-4a92-9771-a53bc98b4e91 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lazy-loading 'fault' on Instance uuid 20195acb-7356-4e87-a2a8-1ee88cd3e3ea {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:17:25.750399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5d768104-73fd-4a92-9771-a53bc98b4e91 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:25.768529 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5d768104-73fd-4a92-9771-a53bc98b4e91 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 200 len: 1330 microversion: 2.1 time: 0.233358 Jul 26 17:17:25.769225 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 302/537] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:25 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 1330 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:26.234044 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9e304cfe-78e8-427a-9d5c-4e15ce20e9f1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:26.234820 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9e304cfe-78e8-427a-9d5c-4e15ce20e9f1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:26.255171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9e304cfe-78e8-427a-9d5c-4e15ce20e9f1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:26.255782 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9e304cfe-78e8-427a-9d5c-4e15ce20e9f1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:26.258367 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9e304cfe-78e8-427a-9d5c-4e15ce20e9f1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:26.260253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9e304cfe-78e8-427a-9d5c-4e15ce20e9f1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:26.479015 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9e304cfe-78e8-427a-9d5c-4e15ce20e9f1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:26.485203 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c74f245f-0afb-4e55-9284-2d7105e295c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:26.491857 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c74f245f-0afb-4e55-9284-2d7105e295c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:26.530165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9e304cfe-78e8-427a-9d5c-4e15ce20e9f1 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1505 microversion: 2.1 time: 0.302845 Jul 26 17:17:26.534552 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c74f245f-0afb-4e55-9284-2d7105e295c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:26.535015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c74f245f-0afb-4e55-9284-2d7105e295c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:26.535186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 236/538] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:26 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:26.539128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c74f245f-0afb-4e55-9284-2d7105e295c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:26.563401 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c74f245f-0afb-4e55-9284-2d7105e295c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:26.564630 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d7f3ce59-157c-419d-8622-fd1ac398f6f9 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce6099d0-20ea-40a7-944b-a03640057ce2", "device": "/dev/sdb"}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:26.569494 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d7f3ce59-157c-419d-8622-fd1ac398f6f9 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:26.581215 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d7f3ce59-157c-419d-8622-fd1ac398f6f9 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:26.581640 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d7f3ce59-157c-419d-8622-fd1ac398f6f9 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:26.582769 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d7f3ce59-157c-419d-8622-fd1ac398f6f9 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:26.584130 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d7f3ce59-157c-419d-8622-fd1ac398f6f9 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:27.006421 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d7f3ce59-157c-419d-8622-fd1ac398f6f9 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "POST /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.450130 Jul 26 17:17:27.016556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 237/539] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:17:26 2022] POST /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:17:27.030933 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ff4d21cf-5801-45dd-b79d-aff4a47a5b7b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:27.032254 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ff4d21cf-5801-45dd-b79d-aff4a47a5b7b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:27.044823 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ff4d21cf-5801-45dd-b79d-aff4a47a5b7b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:27.046377 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ff4d21cf-5801-45dd-b79d-aff4a47a5b7b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:27.047945 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ff4d21cf-5801-45dd-b79d-aff4a47a5b7b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:27.048584 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ff4d21cf-5801-45dd-b79d-aff4a47a5b7b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:27.068553 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-ff4d21cf-5801-45dd-b79d-aff4a47a5b7b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ff4d21cf-5801-45dd-b79d-aff4a47a5b7b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea HTTP/1.1 Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:17:27.071392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:17:27.073055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:17:27.073055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:17:27.073055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:17:27.073055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:17:27.073055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:17:27.073055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:17:27.073055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:17:27.073055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:17:27.073055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:17:27.073055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:17:27.073055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:17:27.073055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '20195acb-7356-4e87-a2a8-1ee88cd3e3ea'} Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:17:27.074505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:17:27.076051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:17:27.079414 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ff4d21cf-5801-45dd-b79d-aff4a47a5b7b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 404 to user: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:17:27.080790 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ff4d21cf-5801-45dd-b79d-aff4a47a5b7b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 404 len: 111 microversion: 2.1 time: 0.071836 Jul 26 17:17:27.082041 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 238/540] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:27 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:17:27.104230 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6761e4d7-6026-4f94-968e-59790b7fe2a8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '.version_select at 0x7f6ca9271790>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:27.157880 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6761e4d7-6026-4f94-968e-59790b7fe2a8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-583507972" status: 202 len: 0 microversion: 2.1 time: 0.067053 Jul 26 17:17:27.160869 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 239/541] 10.222.0.48 () {58 vars in 1218 bytes} [Tue Jul 26 17:17:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-583507972 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:17:27.399497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c74f245f-0afb-4e55-9284-2d7105e295c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:27.428523 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c74f245f-0afb-4e55-9284-2d7105e295c3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1677 microversion: 2.1 time: 0.963514 Jul 26 17:17:27.430562 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 303/542] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:26 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1677 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:27.884793 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1572182572", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-391504489", "security_groups": [{"name": "tempest-secgroup-smoke-1762673915"}], "networks": [{"uuid": "b631e0f4-b364-4d13-9a51-b4d4de1892c8"}], "block_device_mapping_v2": [{"uuid": "7b27fc37-a7d9-46f0-a578-8e5556d3b86f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:28.058919 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.network.neutron [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] validate_networks() for [('b631e0f4-b364-4d13-9a51-b4d4de1892c8', None, None, None, None, None)] {{(pid=118122) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:17:28.187536 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-16f237a5-b7b1-4082-9d9c-7e970a7220b7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: .version_select at 0x7f6ca899f700>, body: {"keypair": {"name": "tempest-keypair-1642786410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmiyj5Tw+t/SmnSed3y2jr176cdBUl6su+Lry1WqwTc0VeMTYYVEp0xsl9EwERRuNYLszbDK/I/rmfBVlLuGgTXPh/SGdvHmpQV3R3zQCJ7g7tREL3ogJv1KeRU233XIw=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:28.240772 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-16f237a5-b7b1-4082-9d9c-7e970a7220b7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:17:28.255897 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-16f237a5-b7b1-4082-9d9c-7e970a7220b7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for user c6291932ceb84b03924c0f056f29c2a9 and project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:17:28.310043 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-16f237a5-b7b1-4082-9d9c-7e970a7220b7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127072 Jul 26 17:17:28.311872 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 304/543] 10.222.0.48 () {60 vars in 1159 bytes} [Tue Jul 26 17:17:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:17:28.466801 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0ab657fd-55f3-4031-a7e3-6ff259b9e159 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:28.468365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0ab657fd-55f3-4031-a7e3-6ff259b9e159 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:28.482711 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ab657fd-55f3-4031-a7e3-6ff259b9e159 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:28.483725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ab657fd-55f3-4031-a7e3-6ff259b9e159 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:28.487708 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ab657fd-55f3-4031-a7e3-6ff259b9e159 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:28.489286 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ab657fd-55f3-4031-a7e3-6ff259b9e159 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:28.681347 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Flavor limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:17:28.681807 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Image limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:17:28.682408 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Flavor pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:17:28.682920 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Image pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:17:28.683511 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:17:28.697091 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:28.697553 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:28.698373 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:28.698813 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:28.736894 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Getting quotas for project 0a543d5eb6ef45569e57965779e4753e. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:17:28.742824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Getting quotas for user d84cca5fc64f46109e9e62394da12437 and project 0a543d5eb6ef45569e57965779e4753e. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:17:28.827477 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Going to run 1 instances... {{(pid=118122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:17:28.830599 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b27fc37-a7d9-46f0-a578-8e5556d3b86f',volume_size=None,volume_type=None)] {{(pid=118122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:17:28.915667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0ab657fd-55f3-4031-a7e3-6ff259b9e159 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:28.931870 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0ab657fd-55f3-4031-a7e3-6ff259b9e159 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1677 microversion: 2.1 time: 0.481293 Jul 26 17:17:28.932853 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 305/544] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:28 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1677 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:29.040914 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7073b99f-4f9f-453e-b2f6-eaf5d4ca99cf tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.160555 Jul 26 17:17:29.042568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 240/545] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:17:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:17:29.056777 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2cbda73e-1c6f-46a1-8c4a-bcb29014d2d8 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:29.057508 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2cbda73e-1c6f-46a1-8c4a-bcb29014d2d8 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:29.225671 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2cbda73e-1c6f-46a1-8c4a-bcb29014d2d8 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:29.262882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2cbda73e-1c6f-46a1-8c4a-bcb29014d2d8 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1088 microversion: 2.1 time: 0.207091 Jul 26 17:17:29.268718 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 306/546] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:29 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1088 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:29.962056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8d9a29ab-60af-406f-9ba5-7c9116164829 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:29.963140 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8d9a29ab-60af-406f-9ba5-7c9116164829 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:29.990829 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8d9a29ab-60af-406f-9ba5-7c9116164829 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:29.992144 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8d9a29ab-60af-406f-9ba5-7c9116164829 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:29.996826 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8d9a29ab-60af-406f-9ba5-7c9116164829 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:29.999246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8d9a29ab-60af-406f-9ba5-7c9116164829 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:30.298419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-12d15a50-e723-435c-b294-387eb80fee7b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:30.299257 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-12d15a50-e723-435c-b294-387eb80fee7b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:30.320169 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12d15a50-e723-435c-b294-387eb80fee7b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:30.320948 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12d15a50-e723-435c-b294-387eb80fee7b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:30.322530 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12d15a50-e723-435c-b294-387eb80fee7b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:30.328445 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12d15a50-e723-435c-b294-387eb80fee7b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:30.502319 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-12d15a50-e723-435c-b294-387eb80fee7b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:30.517175 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-12d15a50-e723-435c-b294-387eb80fee7b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1130 microversion: 2.1 time: 0.223743 Jul 26 17:17:30.518500 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 307/547] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:30 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1130 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:30.633793 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8d9a29ab-60af-406f-9ba5-7c9116164829 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:30.645589 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8d9a29ab-60af-406f-9ba5-7c9116164829 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1654 microversion: 2.1 time: 0.688926 Jul 26 17:17:30.650706 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 241/548] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:29 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1654 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:30.673280 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c0620891-a595-4f68-8ca9-11956c9f6158 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:30.690320 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c0620891-a595-4f68-8ca9-11956c9f6158 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:30.693016 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c0620891-a595-4f68-8ca9-11956c9f6158 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:30.761230 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c0620891-a595-4f68-8ca9-11956c9f6158 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Going to try to start instance {{(pid=118121) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 17:17:30.851428 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c0620891-a595-4f68-8ca9-11956c9f6158 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "POST /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/action" status: 202 len: 0 microversion: 2.1 time: 0.184372 Jul 26 17:17:30.859065 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 308/549] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:17:30 2022] POST /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:17:30.868789 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-dae70151-ff29-4935-b5a9-30e0d2494861 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:30.869563 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-dae70151-ff29-4935-b5a9-30e0d2494861 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:30.879046 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dae70151-ff29-4935-b5a9-30e0d2494861 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:30.879881 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dae70151-ff29-4935-b5a9-30e0d2494861 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:30.880928 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dae70151-ff29-4935-b5a9-30e0d2494861 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:30.882291 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dae70151-ff29-4935-b5a9-30e0d2494861 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:31.330024 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-dae70151-ff29-4935-b5a9-30e0d2494861 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:31.361750 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-dae70151-ff29-4935-b5a9-30e0d2494861 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1663 microversion: 2.1 time: 0.493111 Jul 26 17:17:31.363447 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 242/550] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:30 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1663 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:31.493596 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-214772981", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "734c8f5e-6756-4577-8da6-4e85b95dd0b0"}], "security_groups": [{"name": "tempest-securitygroup--367044269"}], "key_name": "tempest-keypair-1642786410", "user_data": "}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:31.552169 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-20e41c46-bb64-4079-bf86-a806bd96f7e5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:31.563647 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-20e41c46-bb64-4079-bf86-a806bd96f7e5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:31.583546 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-20e41c46-bb64-4079-bf86-a806bd96f7e5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:31.584282 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-20e41c46-bb64-4079-bf86-a806bd96f7e5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:31.585369 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-20e41c46-bb64-4079-bf86-a806bd96f7e5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:31.589377 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-20e41c46-bb64-4079-bf86-a806bd96f7e5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:31.713197 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-20e41c46-bb64-4079-bf86-a806bd96f7e5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:31.724938 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-20e41c46-bb64-4079-bf86-a806bd96f7e5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1204 microversion: 2.1 time: 0.175481 Jul 26 17:17:31.726190 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 243/551] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:31 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1204 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:31.942690 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] validate_networks() for [('734c8f5e-6756-4577-8da6-4e85b95dd0b0', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:17:32.384485 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-263ad306-63f2-434d-ad3c-fe41844104dc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:32.385529 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-263ad306-63f2-434d-ad3c-fe41844104dc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:32.412318 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-263ad306-63f2-434d-ad3c-fe41844104dc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:32.413565 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-263ad306-63f2-434d-ad3c-fe41844104dc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:32.413779 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-263ad306-63f2-434d-ad3c-fe41844104dc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:32.414228 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-263ad306-63f2-434d-ad3c-fe41844104dc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:32.907050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-263ad306-63f2-434d-ad3c-fe41844104dc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:32.937569 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-263ad306-63f2-434d-ad3c-fe41844104dc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1663 microversion: 2.1 time: 0.556823 Jul 26 17:17:32.954203 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 244/552] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:32 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1663 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:32.960741 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2f84002f-2b49-4993-8e61-3baa3bd2dac1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:32.961699 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2f84002f-2b49-4993-8e61-3baa3bd2dac1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:32.969844 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2f84002f-2b49-4993-8e61-3baa3bd2dac1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:32.970606 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2f84002f-2b49-4993-8e61-3baa3bd2dac1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:32.971590 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2f84002f-2b49-4993-8e61-3baa3bd2dac1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:32.972223 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2f84002f-2b49-4993-8e61-3baa3bd2dac1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:32.995431 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:33.068010 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-2f84002f-2b49-4993-8e61-3baa3bd2dac1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:33.084132 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2f84002f-2b49-4993-8e61-3baa3bd2dac1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1204 microversion: 2.1 time: 0.128360 Jul 26 17:17:33.096988 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 245/553] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:32 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1204 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:33.660359 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:17:33.661961 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:17:33.662779 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:17:33.663353 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:17:33.663918 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:17:33.677914 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:33.679138 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:33.679997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:33.680429 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:33.708288 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:17:33.714319 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for user c6291932ceb84b03924c0f056f29c2a9 and project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:17:33.731413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:17:33.735702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:17:33.833348 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0ee40f20-b31c-45e1-83b4-031d024a9092 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.343873 Jul 26 17:17:33.833348 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 309/554] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:17:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 2345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:17:33.845426 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f214597f-6235-4d2f-b0d7-5752c6f6f8aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:33.846311 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-f214597f-6235-4d2f-b0d7-5752c6f6f8aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:33.970036 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1160f233-4043-4ce8-9b24-d9cbc5468031 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:33.970984 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1160f233-4043-4ce8-9b24-d9cbc5468031 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:33.973144 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-f214597f-6235-4d2f-b0d7-5752c6f6f8aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:33.981676 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1160f233-4043-4ce8-9b24-d9cbc5468031 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:33.982115 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1160f233-4043-4ce8-9b24-d9cbc5468031 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:33.982930 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1160f233-4043-4ce8-9b24-d9cbc5468031 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:33.988495 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1160f233-4043-4ce8-9b24-d9cbc5468031 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:33.989219 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-f214597f-6235-4d2f-b0d7-5752c6f6f8aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1241 microversion: 2.1 time: 0.147566 Jul 26 17:17:33.992114 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 246/555] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:33 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:34.111792 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1b57710d-c240-416b-90a5-e22ebb3de357 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:34.112585 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1b57710d-c240-416b-90a5-e22ebb3de357 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:34.121979 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b57710d-c240-416b-90a5-e22ebb3de357 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:34.122608 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b57710d-c240-416b-90a5-e22ebb3de357 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:34.123814 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b57710d-c240-416b-90a5-e22ebb3de357 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:34.124375 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b57710d-c240-416b-90a5-e22ebb3de357 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:34.236219 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1b57710d-c240-416b-90a5-e22ebb3de357 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:34.248219 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1b57710d-c240-416b-90a5-e22ebb3de357 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1204 microversion: 2.1 time: 0.140700 Jul 26 17:17:34.264460 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 247/556] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:34 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1204 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:34.281910 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-42ce2b4c-97a1-4d52-80ec-6b2042306f9e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:34.284454 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-42ce2b4c-97a1-4d52-80ec-6b2042306f9e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:34.295876 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-42ce2b4c-97a1-4d52-80ec-6b2042306f9e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:34.299277 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-42ce2b4c-97a1-4d52-80ec-6b2042306f9e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:34.302132 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-42ce2b4c-97a1-4d52-80ec-6b2042306f9e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:34.303414 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-42ce2b4c-97a1-4d52-80ec-6b2042306f9e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:34.354334 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1160f233-4043-4ce8-9b24-d9cbc5468031 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:34.363502 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1160f233-4043-4ce8-9b24-d9cbc5468031 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1663 microversion: 2.1 time: 0.402454 Jul 26 17:17:34.364153 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.objects.instance [None req-42ce2b4c-97a1-4d52-80ec-6b2042306f9e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lazy-loading 'flavor' on Instance uuid 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce {{(pid=118122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:17:34.385001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 310/557] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:33 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1663 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:34.706821 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-42ce2b4c-97a1-4d52-80ec-6b2042306f9e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "POST /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/action" status: 200 len: 32 microversion: 2.1 time: 0.439541 Jul 26 17:17:34.707863 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 248/558] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:17:34 2022] POST /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/action => generated 32 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 17:17:34.721195 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d41bd3f2-d98c-411f-a602-d783e02d70de tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:34.722437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d41bd3f2-d98c-411f-a602-d783e02d70de tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:34.735570 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d41bd3f2-d98c-411f-a602-d783e02d70de tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:34.736388 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d41bd3f2-d98c-411f-a602-d783e02d70de tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:34.737653 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d41bd3f2-d98c-411f-a602-d783e02d70de tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:34.738357 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d41bd3f2-d98c-411f-a602-d783e02d70de tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:35.024001 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7160123d-5ca1-43dd-a873-9b64c33033c2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:35.026641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7160123d-5ca1-43dd-a873-9b64c33033c2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:35.053398 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7160123d-5ca1-43dd-a873-9b64c33033c2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:35.054745 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7160123d-5ca1-43dd-a873-9b64c33033c2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:35.056361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7160123d-5ca1-43dd-a873-9b64c33033c2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:35.059153 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7160123d-5ca1-43dd-a873-9b64c33033c2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:35.075001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d41bd3f2-d98c-411f-a602-d783e02d70de tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:35.092079 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d41bd3f2-d98c-411f-a602-d783e02d70de tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.369432 Jul 26 17:17:35.093541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 311/559] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:34 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:35.187761 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7160123d-5ca1-43dd-a873-9b64c33033c2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:35.200489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7160123d-5ca1-43dd-a873-9b64c33033c2 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1293 microversion: 2.1 time: 0.187384 Jul 26 17:17:35.216227 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 249/560] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:35 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1293 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:35.271635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-68ea60f3-aff7-4466-8ae8-a5ee52e62e42 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:35.274385 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-68ea60f3-aff7-4466-8ae8-a5ee52e62e42 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:35.288305 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68ea60f3-aff7-4466-8ae8-a5ee52e62e42 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:35.293441 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68ea60f3-aff7-4466-8ae8-a5ee52e62e42 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:35.294749 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68ea60f3-aff7-4466-8ae8-a5ee52e62e42 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:35.295733 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68ea60f3-aff7-4466-8ae8-a5ee52e62e42 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:35.397437 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b61119a2-30b7-4a61-b486-7292404e657a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:35.406244 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b61119a2-30b7-4a61-b486-7292404e657a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:35.431031 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b61119a2-30b7-4a61-b486-7292404e657a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:35.431764 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b61119a2-30b7-4a61-b486-7292404e657a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:35.432779 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b61119a2-30b7-4a61-b486-7292404e657a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:35.434648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b61119a2-30b7-4a61-b486-7292404e657a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:35.759190 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-68ea60f3-aff7-4466-8ae8-a5ee52e62e42 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:35.768380 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-68ea60f3-aff7-4466-8ae8-a5ee52e62e42 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1272 microversion: 2.1 time: 0.500422 Jul 26 17:17:35.776289 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-b61119a2-30b7-4a61-b486-7292404e657a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:35.788287 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b61119a2-30b7-4a61-b486-7292404e657a tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1667 microversion: 2.1 time: 0.394504 Jul 26 17:17:35.788753 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 312/561] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:35 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1272 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:35.789554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 250/562] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:35 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1667 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:36.120781 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2e5c6a0c-c714-4abc-9ad9-c04b8c5b1654 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:36.123362 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2e5c6a0c-c714-4abc-9ad9-c04b8c5b1654 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:36.143623 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e5c6a0c-c714-4abc-9ad9-c04b8c5b1654 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:36.144563 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e5c6a0c-c714-4abc-9ad9-c04b8c5b1654 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:36.157292 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e5c6a0c-c714-4abc-9ad9-c04b8c5b1654 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:36.158002 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e5c6a0c-c714-4abc-9ad9-c04b8c5b1654 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:36.187466 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:36.207815 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-ccc6de10-928c-49ab-8368-93b1c014467a req-ed11af05-7fa9-4036-8d92-5360f4d5a2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b93f34-9005-40dc-acb1-496c1eaf53c6", "tag": "106ac6cf-a172-4113-980c-418b8d51f6a4"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:36.310093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-ccc6de10-928c-49ab-8368-93b1c014467a req-ed11af05-7fa9-4036-8d92-5360f4d5a2a7 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:36.312425 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-ccc6de10-928c-49ab-8368-93b1c014467a req-ed11af05-7fa9-4036-8d92-5360f4d5a2a7 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:36.357789 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-ccc6de10-928c-49ab-8368-93b1c014467a req-ed11af05-7fa9-4036-8d92-5360f4d5a2a7 service nova] Creating event network-changed:106ac6cf-a172-4113-980c-418b8d51f6a4 for instance 95b93f34-9005-40dc-acb1-496c1eaf53c6 on hv-cinder-83538 Jul 26 17:17:36.369558 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-ccc6de10-928c-49ab-8368-93b1c014467a req-ed11af05-7fa9-4036-8d92-5360f4d5a2a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179144 Jul 26 17:17:36.375131 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 251/563] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:17:36.403560 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-77cb6428-7592-4554-a7ee-b8a403ab1f75 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:36.403560 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-77cb6428-7592-4554-a7ee-b8a403ab1f75 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:36.407849 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-77cb6428-7592-4554-a7ee-b8a403ab1f75 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:36.408497 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-77cb6428-7592-4554-a7ee-b8a403ab1f75 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:36.409506 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-77cb6428-7592-4554-a7ee-b8a403ab1f75 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:36.409946 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-77cb6428-7592-4554-a7ee-b8a403ab1f75 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:36.608540 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-77cb6428-7592-4554-a7ee-b8a403ab1f75 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:36.621931 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-77cb6428-7592-4554-a7ee-b8a403ab1f75 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1299 microversion: 2.1 time: 0.246690 Jul 26 17:17:36.622685 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 252/564] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:36 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1299 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:36.644948 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2e5c6a0c-c714-4abc-9ad9-c04b8c5b1654 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:36.657441 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2e5c6a0c-c714-4abc-9ad9-c04b8c5b1654 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.545308 Jul 26 17:17:36.658700 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 313/565] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:36 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:36.797801 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ab6aefe3-c0bd-4f4c-8476-099b643288b1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:36.798417 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ab6aefe3-c0bd-4f4c-8476-099b643288b1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:36.807502 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ab6aefe3-c0bd-4f4c-8476-099b643288b1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:36.808308 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ab6aefe3-c0bd-4f4c-8476-099b643288b1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:36.811714 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ab6aefe3-c0bd-4f4c-8476-099b643288b1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:36.812331 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ab6aefe3-c0bd-4f4c-8476-099b643288b1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:37.412779 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ab6aefe3-c0bd-4f4c-8476-099b643288b1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:37.429980 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ab6aefe3-c0bd-4f4c-8476-099b643288b1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1272 microversion: 2.1 time: 0.635888 Jul 26 17:17:37.432430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 253/566] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:36 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1272 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:37.647547 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4046f55a-3477-47cd-a5c7-db4e6f90b286 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:37.649127 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4046f55a-3477-47cd-a5c7-db4e6f90b286 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:37.657271 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4046f55a-3477-47cd-a5c7-db4e6f90b286 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:37.658116 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4046f55a-3477-47cd-a5c7-db4e6f90b286 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:37.659609 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4046f55a-3477-47cd-a5c7-db4e6f90b286 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:37.660302 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4046f55a-3477-47cd-a5c7-db4e6f90b286 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:37.688758 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c3e7f598-13bc-42f0-8780-6ade5cb239d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:37.689580 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c3e7f598-13bc-42f0-8780-6ade5cb239d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:37.707784 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c3e7f598-13bc-42f0-8780-6ade5cb239d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:37.708479 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c3e7f598-13bc-42f0-8780-6ade5cb239d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:37.709984 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c3e7f598-13bc-42f0-8780-6ade5cb239d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:37.712593 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c3e7f598-13bc-42f0-8780-6ade5cb239d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:37.960326 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c3e7f598-13bc-42f0-8780-6ade5cb239d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:37.963135 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4046f55a-3477-47cd-a5c7-db4e6f90b286 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:37.970366 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c3e7f598-13bc-42f0-8780-6ade5cb239d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.286682 Jul 26 17:17:37.971542 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 254/567] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:37 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:37.973902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4046f55a-3477-47cd-a5c7-db4e6f90b286 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.329201 Jul 26 17:17:37.981631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 314/568] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:37 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:38.461338 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a10f3c9c-b1d7-4cc9-a13c-3bdfcfbffcf1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:38.462965 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a10f3c9c-b1d7-4cc9-a13c-3bdfcfbffcf1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:38.476075 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a10f3c9c-b1d7-4cc9-a13c-3bdfcfbffcf1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:38.477168 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a10f3c9c-b1d7-4cc9-a13c-3bdfcfbffcf1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:38.478838 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a10f3c9c-b1d7-4cc9-a13c-3bdfcfbffcf1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:38.479883 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a10f3c9c-b1d7-4cc9-a13c-3bdfcfbffcf1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:38.677571 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a10f3c9c-b1d7-4cc9-a13c-3bdfcfbffcf1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:38.687026 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a10f3c9c-b1d7-4cc9-a13c-3bdfcfbffcf1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1272 microversion: 2.1 time: 0.230817 Jul 26 17:17:38.687754 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 255/569] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:38 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:38.834511 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-de321dad-1b09-4adc-a461-6393d59e75f6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Action: 'create', calling method: .version_select at 0x7f6ca8990c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1393964861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4GqQG+tBkZxnWh++0EfA7s+Bm7cTZQBo86E4eUORP8FyMmzj82Alr0iJ5+R4WeSNuGKQsgVFryfANOxvwFS3uHgAmxMeHz6qS1FMHaMV9eEzxvfUPi3xHfNuZaQOfkWQ=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:38.855966 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-de321dad-1b09-4adc-a461-6393d59e75f6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Getting quotas for project b888b1053bb043dbb88d674c9a504a86. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:17:38.860504 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-de321dad-1b09-4adc-a461-6393d59e75f6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Getting quotas for user dcf968aeb53c4215927642e9931b4a5e and project b888b1053bb043dbb88d674c9a504a86. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:17:38.884669 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-de321dad-1b09-4adc-a461-6393d59e75f6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.262112 Jul 26 17:17:38.885630 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 315/570] 10.222.0.48 () {60 vars in 1159 bytes} [Tue Jul 26 17:17:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:17:39.000511 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-db582efb-93a0-4c55-9127-9d98469603aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:39.002038 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-db582efb-93a0-4c55-9127-9d98469603aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:39.002647 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1cacc8ed-1ef3-4ce6-a731-3e55614cfc10 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:39.004548 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1cacc8ed-1ef3-4ce6-a731-3e55614cfc10 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:39.012905 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:39.018370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db582efb-93a0-4c55-9127-9d98469603aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:39.019216 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db582efb-93a0-4c55-9127-9d98469603aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:39.020575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1cacc8ed-1ef3-4ce6-a731-3e55614cfc10 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:39.021578 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db582efb-93a0-4c55-9127-9d98469603aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:39.022090 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db582efb-93a0-4c55-9127-9d98469603aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:39.022538 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1cacc8ed-1ef3-4ce6-a731-3e55614cfc10 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:39.026781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1cacc8ed-1ef3-4ce6-a731-3e55614cfc10 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:39.027581 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1cacc8ed-1ef3-4ce6-a731-3e55614cfc10 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:39.266389 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1cacc8ed-1ef3-4ce6-a731-3e55614cfc10 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:39.275214 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1cacc8ed-1ef3-4ce6-a731-3e55614cfc10 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.287056 Jul 26 17:17:39.276109 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 256/571] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:38 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:39.510440 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-db582efb-93a0-4c55-9127-9d98469603aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:39.524765 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-db582efb-93a0-4c55-9127-9d98469603aa tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.532967 Jul 26 17:17:39.525447 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 316/572] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:38 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:39.711910 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c0047fee-3500-45bf-9f24-ef6891887f86 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:39.714180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c0047fee-3500-45bf-9f24-ef6891887f86 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:39.740304 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c0047fee-3500-45bf-9f24-ef6891887f86 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:39.740835 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c0047fee-3500-45bf-9f24-ef6891887f86 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:39.741725 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c0047fee-3500-45bf-9f24-ef6891887f86 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:39.742145 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c0047fee-3500-45bf-9f24-ef6891887f86 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:40.132696 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c0047fee-3500-45bf-9f24-ef6891887f86 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:40.146642 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c0047fee-3500-45bf-9f24-ef6891887f86 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1272 microversion: 2.1 time: 0.441514 Jul 26 17:17:40.162879 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 257/573] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:39 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1272 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:40.313187 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3d298d89-f5ba-4094-9c82-8c03d37b95e9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:40.314380 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3d298d89-f5ba-4094-9c82-8c03d37b95e9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:40.326954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d298d89-f5ba-4094-9c82-8c03d37b95e9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:40.329816 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d298d89-f5ba-4094-9c82-8c03d37b95e9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:40.332916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d298d89-f5ba-4094-9c82-8c03d37b95e9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:40.333625 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d298d89-f5ba-4094-9c82-8c03d37b95e9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:40.385278 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-21a0e3c5-f640-41ac-95fe-2aafa337a562 req-e5136910-21fd-4784-b43d-fade0cd125f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1e9557-fc15-4ea5-9b93-de135b76dfeb", "tag": "31c721ef-3c46-4353-858f-597f80f0ca60"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:40.414166 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-21a0e3c5-f640-41ac-95fe-2aafa337a562 req-e5136910-21fd-4784-b43d-fade0cd125f1 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:40.414901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-21a0e3c5-f640-41ac-95fe-2aafa337a562 req-e5136910-21fd-4784-b43d-fade0cd125f1 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:40.471496 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-21a0e3c5-f640-41ac-95fe-2aafa337a562 req-e5136910-21fd-4784-b43d-fade0cd125f1 service nova] Creating event network-changed:31c721ef-3c46-4353-858f-597f80f0ca60 for instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb on hv-cinder-83538 Jul 26 17:17:40.483455 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-21a0e3c5-f640-41ac-95fe-2aafa337a562 req-e5136910-21fd-4784-b43d-fade0cd125f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102742 Jul 26 17:17:40.487659 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 258/574] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:17:40.549636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-72612b65-a18b-4dc0-935e-4319396ce58a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:40.550694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-72612b65-a18b-4dc0-935e-4319396ce58a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:40.565776 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-72612b65-a18b-4dc0-935e-4319396ce58a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:40.568072 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-72612b65-a18b-4dc0-935e-4319396ce58a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:40.571565 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-72612b65-a18b-4dc0-935e-4319396ce58a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:40.574617 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-72612b65-a18b-4dc0-935e-4319396ce58a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:41.055483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3d298d89-f5ba-4094-9c82-8c03d37b95e9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:41.079518 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3d298d89-f5ba-4094-9c82-8c03d37b95e9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.771575 Jul 26 17:17:41.080748 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 317/575] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:40 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:41.169310 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-45d1380b-7eb0-4502-aa61-c2eeb0fca3c5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:41.169788 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-72612b65-a18b-4dc0-935e-4319396ce58a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:41.170313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-45d1380b-7eb0-4502-aa61-c2eeb0fca3c5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:41.185690 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-72612b65-a18b-4dc0-935e-4319396ce58a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.640622 Jul 26 17:17:41.187084 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 259/576] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:40 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:41.191189 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45d1380b-7eb0-4502-aa61-c2eeb0fca3c5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:41.191681 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45d1380b-7eb0-4502-aa61-c2eeb0fca3c5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:41.192648 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45d1380b-7eb0-4502-aa61-c2eeb0fca3c5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:41.194403 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45d1380b-7eb0-4502-aa61-c2eeb0fca3c5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:41.682442 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-45d1380b-7eb0-4502-aa61-c2eeb0fca3c5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:41.693080 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-45d1380b-7eb0-4502-aa61-c2eeb0fca3c5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1272 microversion: 2.1 time: 0.528994 Jul 26 17:17:41.694563 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 318/577] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:41 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1272 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:42.103164 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-94e513bc-32a4-4880-b790-8eccdb581c8a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:42.104009 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-94e513bc-32a4-4880-b790-8eccdb581c8a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:42.112687 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-94e513bc-32a4-4880-b790-8eccdb581c8a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:42.113451 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-94e513bc-32a4-4880-b790-8eccdb581c8a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:42.114299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-94e513bc-32a4-4880-b790-8eccdb581c8a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:42.114812 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-94e513bc-32a4-4880-b790-8eccdb581c8a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:42.216147 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a9cedd47-eb93-47c8-a2cb-3e28419e4136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:42.217268 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a9cedd47-eb93-47c8-a2cb-3e28419e4136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:42.238918 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9cedd47-eb93-47c8-a2cb-3e28419e4136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:42.239717 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9cedd47-eb93-47c8-a2cb-3e28419e4136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:42.242092 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9cedd47-eb93-47c8-a2cb-3e28419e4136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:42.242793 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9cedd47-eb93-47c8-a2cb-3e28419e4136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:42.315126 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-94e513bc-32a4-4880-b790-8eccdb581c8a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:42.325894 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-94e513bc-32a4-4880-b790-8eccdb581c8a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.227397 Jul 26 17:17:42.326989 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 260/578] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:42 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:42.432605 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a9cedd47-eb93-47c8-a2cb-3e28419e4136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:42.442018 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a9cedd47-eb93-47c8-a2cb-3e28419e4136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.233921 Jul 26 17:17:42.443050 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 319/579] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:42 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:42.729648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7efc3e2f-828a-46c1-b9a0-124aabfa8335 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:42.730363 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7efc3e2f-828a-46c1-b9a0-124aabfa8335 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:42.736893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7efc3e2f-828a-46c1-b9a0-124aabfa8335 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:42.737427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7efc3e2f-828a-46c1-b9a0-124aabfa8335 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:42.738208 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7efc3e2f-828a-46c1-b9a0-124aabfa8335 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:42.738639 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7efc3e2f-828a-46c1-b9a0-124aabfa8335 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:42.896498 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7efc3e2f-828a-46c1-b9a0-124aabfa8335 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:42.911362 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7efc3e2f-828a-46c1-b9a0-124aabfa8335 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1272 microversion: 2.1 time: 0.185325 Jul 26 17:17:42.912336 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 261/580] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:42 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:43.347826 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-69ec95dd-35f3-411d-91aa-bb7b64fdbe4b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:43.348463 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-69ec95dd-35f3-411d-91aa-bb7b64fdbe4b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:43.357272 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69ec95dd-35f3-411d-91aa-bb7b64fdbe4b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:43.357941 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69ec95dd-35f3-411d-91aa-bb7b64fdbe4b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:43.358807 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69ec95dd-35f3-411d-91aa-bb7b64fdbe4b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:43.359430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69ec95dd-35f3-411d-91aa-bb7b64fdbe4b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:43.463925 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2d4270a9-e58e-4724-9b57-6f860a02efb8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:43.464636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2d4270a9-e58e-4724-9b57-6f860a02efb8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:43.472410 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2d4270a9-e58e-4724-9b57-6f860a02efb8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:43.472881 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2d4270a9-e58e-4724-9b57-6f860a02efb8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:43.473698 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2d4270a9-e58e-4724-9b57-6f860a02efb8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:43.474135 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2d4270a9-e58e-4724-9b57-6f860a02efb8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:43.494929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:43.518634 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-69ec95dd-35f3-411d-91aa-bb7b64fdbe4b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:43.527952 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-69ec95dd-35f3-411d-91aa-bb7b64fdbe4b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.183324 Jul 26 17:17:43.528874 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 320/581] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:43 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:43.636878 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-2d4270a9-e58e-4724-9b57-6f860a02efb8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:43.644882 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2d4270a9-e58e-4724-9b57-6f860a02efb8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.184815 Jul 26 17:17:43.645515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 262/582] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:43 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:43.944065 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-37e6cbf9-23d2-44a8-8570-6004f0e12004 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:43.944674 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-37e6cbf9-23d2-44a8-8570-6004f0e12004 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:43.946572 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:43.952717 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37e6cbf9-23d2-44a8-8570-6004f0e12004 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:43.953186 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37e6cbf9-23d2-44a8-8570-6004f0e12004 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:43.954044 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37e6cbf9-23d2-44a8-8570-6004f0e12004 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:43.954463 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37e6cbf9-23d2-44a8-8570-6004f0e12004 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:44.097454 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-37e6cbf9-23d2-44a8-8570-6004f0e12004 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:44.104875 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-37e6cbf9-23d2-44a8-8570-6004f0e12004 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1272 microversion: 2.1 time: 0.164972 Jul 26 17:17:44.106054 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 321/583] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:43 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:44.568681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6a114fdf-ab52-453d-a731-9e4e7e683fa1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:44.569633 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6a114fdf-ab52-453d-a731-9e4e7e683fa1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:44.571696 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=8 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:44.578935 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6a114fdf-ab52-453d-a731-9e4e7e683fa1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:44.579392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6a114fdf-ab52-453d-a731-9e4e7e683fa1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:44.580323 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6a114fdf-ab52-453d-a731-9e4e7e683fa1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:44.580743 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6a114fdf-ab52-453d-a731-9e4e7e683fa1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:44.667834 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-714236c6-693c-48e2-81a3-45083d7d9224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:44.669558 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-714236c6-693c-48e2-81a3-45083d7d9224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:44.680309 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-714236c6-693c-48e2-81a3-45083d7d9224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:44.681492 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-714236c6-693c-48e2-81a3-45083d7d9224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:44.682863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-714236c6-693c-48e2-81a3-45083d7d9224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:44.683659 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-714236c6-693c-48e2-81a3-45083d7d9224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:44.753189 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6a114fdf-ab52-453d-a731-9e4e7e683fa1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:44.763061 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6a114fdf-ab52-453d-a731-9e4e7e683fa1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.197395 Jul 26 17:17:44.763837 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 263/584] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:44 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:44.865429 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-714236c6-693c-48e2-81a3-45083d7d9224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:44.873075 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-714236c6-693c-48e2-81a3-45083d7d9224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.210613 Jul 26 17:17:44.873671 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 322/585] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:44 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:45.127169 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e71083fc-8874-403e-98b2-2d3538631a9b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:45.127928 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-e71083fc-8874-403e-98b2-2d3538631a9b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:45.134628 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e71083fc-8874-403e-98b2-2d3538631a9b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:45.135082 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e71083fc-8874-403e-98b2-2d3538631a9b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:45.135861 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e71083fc-8874-403e-98b2-2d3538631a9b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:45.136817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e71083fc-8874-403e-98b2-2d3538631a9b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:45.306331 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e71083fc-8874-403e-98b2-2d3538631a9b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:45.315087 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e71083fc-8874-403e-98b2-2d3538631a9b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1260 microversion: 2.1 time: 0.192048 Jul 26 17:17:45.315684 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 264/586] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:45 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:45.784981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-85db8469-7bfb-41e5-9ed5-15875f08aa18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:45.785612 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-85db8469-7bfb-41e5-9ed5-15875f08aa18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:45.793306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85db8469-7bfb-41e5-9ed5-15875f08aa18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:45.793759 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85db8469-7bfb-41e5-9ed5-15875f08aa18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:45.794550 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85db8469-7bfb-41e5-9ed5-15875f08aa18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:45.795397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85db8469-7bfb-41e5-9ed5-15875f08aa18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:45.899082 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ee895446-b621-4e4a-b286-5e67868143e8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:45.899719 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ee895446-b621-4e4a-b286-5e67868143e8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:45.907489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ee895446-b621-4e4a-b286-5e67868143e8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:45.907940 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ee895446-b621-4e4a-b286-5e67868143e8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:45.908734 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ee895446-b621-4e4a-b286-5e67868143e8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:45.909210 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ee895446-b621-4e4a-b286-5e67868143e8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:45.963014 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-85db8469-7bfb-41e5-9ed5-15875f08aa18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:45.977886 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-85db8469-7bfb-41e5-9ed5-15875f08aa18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.196320 Jul 26 17:17:45.979188 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 323/587] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:45 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:46.087551 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ee895446-b621-4e4a-b286-5e67868143e8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:46.101335 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ee895446-b621-4e4a-b286-5e67868143e8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.209429 Jul 26 17:17:46.102438 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 265/588] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:45 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:46.337924 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bbdc3f3f-e75f-4535-b3ea-ef6970089717 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:46.338544 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bbdc3f3f-e75f-4535-b3ea-ef6970089717 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:46.345885 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bbdc3f3f-e75f-4535-b3ea-ef6970089717 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:46.346522 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bbdc3f3f-e75f-4535-b3ea-ef6970089717 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:46.347362 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bbdc3f3f-e75f-4535-b3ea-ef6970089717 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:46.347944 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bbdc3f3f-e75f-4535-b3ea-ef6970089717 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:46.569914 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bbdc3f3f-e75f-4535-b3ea-ef6970089717 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:46.583723 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bbdc3f3f-e75f-4535-b3ea-ef6970089717 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1260 microversion: 2.1 time: 0.249162 Jul 26 17:17:46.584846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 324/589] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:46 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:47.014186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-967b3b2b-42f1-4707-9149-1c5319bd96ff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:47.014838 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-967b3b2b-42f1-4707-9149-1c5319bd96ff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:47.021684 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-967b3b2b-42f1-4707-9149-1c5319bd96ff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:47.022139 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-967b3b2b-42f1-4707-9149-1c5319bd96ff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:47.022972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-967b3b2b-42f1-4707-9149-1c5319bd96ff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:47.023421 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-967b3b2b-42f1-4707-9149-1c5319bd96ff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:47.126519 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-68e86fed-41d8-43d4-931e-1ff93a400654 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:47.127389 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-68e86fed-41d8-43d4-931e-1ff93a400654 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:47.134365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68e86fed-41d8-43d4-931e-1ff93a400654 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:47.134823 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68e86fed-41d8-43d4-931e-1ff93a400654 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:47.135613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68e86fed-41d8-43d4-931e-1ff93a400654 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:47.136056 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68e86fed-41d8-43d4-931e-1ff93a400654 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:47.188099 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-967b3b2b-42f1-4707-9149-1c5319bd96ff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:47.197835 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-967b3b2b-42f1-4707-9149-1c5319bd96ff tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.187716 Jul 26 17:17:47.198438 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 266/590] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:47 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:47.319705 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-68e86fed-41d8-43d4-931e-1ff93a400654 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:47.328847 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-68e86fed-41d8-43d4-931e-1ff93a400654 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.206443 Jul 26 17:17:47.329472 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 325/591] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:47 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:47.618523 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-39b25faf-1c2e-48b3-a5dc-da4026e6b663 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:47.619146 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-39b25faf-1c2e-48b3-a5dc-da4026e6b663 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:47.626451 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-39b25faf-1c2e-48b3-a5dc-da4026e6b663 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:47.626897 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-39b25faf-1c2e-48b3-a5dc-da4026e6b663 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:47.627675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-39b25faf-1c2e-48b3-a5dc-da4026e6b663 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:47.628105 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-39b25faf-1c2e-48b3-a5dc-da4026e6b663 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:47.803380 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-39b25faf-1c2e-48b3-a5dc-da4026e6b663 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:47.811684 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-39b25faf-1c2e-48b3-a5dc-da4026e6b663 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1260 microversion: 2.1 time: 0.197010 Jul 26 17:17:47.812284 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 267/592] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:47 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:48.222325 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e5358b54-d7ea-4c5b-8012-96d511bad4b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:48.222943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e5358b54-d7ea-4c5b-8012-96d511bad4b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:48.230203 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5358b54-d7ea-4c5b-8012-96d511bad4b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:48.231413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5358b54-d7ea-4c5b-8012-96d511bad4b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:48.232238 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5358b54-d7ea-4c5b-8012-96d511bad4b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:48.232688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5358b54-d7ea-4c5b-8012-96d511bad4b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:48.351479 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b6476722-191b-4480-b292-465a6817b544 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:48.352172 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b6476722-191b-4480-b292-465a6817b544 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:48.360473 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b6476722-191b-4480-b292-465a6817b544 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:48.361054 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b6476722-191b-4480-b292-465a6817b544 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:48.361920 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b6476722-191b-4480-b292-465a6817b544 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:48.362433 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b6476722-191b-4480-b292-465a6817b544 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:48.405776 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e5358b54-d7ea-4c5b-8012-96d511bad4b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:48.414560 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e5358b54-d7ea-4c5b-8012-96d511bad4b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.196061 Jul 26 17:17:48.415146 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 326/593] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:48 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:48.530471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-b6476722-191b-4480-b292-465a6817b544 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:48.543634 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b6476722-191b-4480-b292-465a6817b544 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.195214 Jul 26 17:17:48.544420 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 268/594] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:48 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:48.847115 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-005af392-858b-4ba8-95a4-0fc0316bf1fd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:48.847755 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-005af392-858b-4ba8-95a4-0fc0316bf1fd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:48.854752 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-005af392-858b-4ba8-95a4-0fc0316bf1fd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:48.855764 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-005af392-858b-4ba8-95a4-0fc0316bf1fd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:48.856818 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-005af392-858b-4ba8-95a4-0fc0316bf1fd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:48.857297 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-005af392-858b-4ba8-95a4-0fc0316bf1fd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:48.875477 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=16 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:49.065663 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-005af392-858b-4ba8-95a4-0fc0316bf1fd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:49.075767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-005af392-858b-4ba8-95a4-0fc0316bf1fd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1260 microversion: 2.1 time: 0.232171 Jul 26 17:17:49.076433 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 327/595] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:48 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:49.452163 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8e5fdb4c-7ec7-4d82-ab04-65cf109519b5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:49.452890 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8e5fdb4c-7ec7-4d82-ab04-65cf109519b5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:49.459848 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8e5fdb4c-7ec7-4d82-ab04-65cf109519b5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:49.460299 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8e5fdb4c-7ec7-4d82-ab04-65cf109519b5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:49.461126 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8e5fdb4c-7ec7-4d82-ab04-65cf109519b5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:49.461567 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8e5fdb4c-7ec7-4d82-ab04-65cf109519b5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:49.569946 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0ae61473-3d34-403f-a244-7a5f69160bae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:49.571177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0ae61473-3d34-403f-a244-7a5f69160bae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:49.590895 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ae61473-3d34-403f-a244-7a5f69160bae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:49.591722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ae61473-3d34-403f-a244-7a5f69160bae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:49.593230 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ae61473-3d34-403f-a244-7a5f69160bae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:49.594017 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ae61473-3d34-403f-a244-7a5f69160bae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:49.633313 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8e5fdb4c-7ec7-4d82-ab04-65cf109519b5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:49.649789 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8e5fdb4c-7ec7-4d82-ab04-65cf109519b5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.201227 Jul 26 17:17:49.653059 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 269/596] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:49 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:49.780161 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0ae61473-3d34-403f-a244-7a5f69160bae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:49.794190 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0ae61473-3d34-403f-a244-7a5f69160bae tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.230907 Jul 26 17:17:49.795248 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 328/597] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:49 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:50.097273 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e89d3309-9ccb-4d7c-92e2-ae1e0ef08ec5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:50.098193 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-e89d3309-9ccb-4d7c-92e2-ae1e0ef08ec5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:50.107599 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e89d3309-9ccb-4d7c-92e2-ae1e0ef08ec5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:50.108155 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e89d3309-9ccb-4d7c-92e2-ae1e0ef08ec5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:50.109331 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e89d3309-9ccb-4d7c-92e2-ae1e0ef08ec5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:50.110007 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e89d3309-9ccb-4d7c-92e2-ae1e0ef08ec5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:50.291805 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e89d3309-9ccb-4d7c-92e2-ae1e0ef08ec5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:50.300266 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e89d3309-9ccb-4d7c-92e2-ae1e0ef08ec5 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1260 microversion: 2.1 time: 0.207053 Jul 26 17:17:50.300841 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 270/598] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:50 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:50.686874 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-439ffbc1-9ba7-4730-a18f-5ff7cad7ce6b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:50.687978 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-439ffbc1-9ba7-4730-a18f-5ff7cad7ce6b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:50.695879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-439ffbc1-9ba7-4730-a18f-5ff7cad7ce6b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:50.696318 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-439ffbc1-9ba7-4730-a18f-5ff7cad7ce6b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:50.697126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-439ffbc1-9ba7-4730-a18f-5ff7cad7ce6b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:50.697576 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-439ffbc1-9ba7-4730-a18f-5ff7cad7ce6b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:50.818768 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-64f0e062-c9df-4d0c-9795-b36c016f7fc1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:50.819659 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-64f0e062-c9df-4d0c-9795-b36c016f7fc1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:50.827493 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-64f0e062-c9df-4d0c-9795-b36c016f7fc1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:50.827765 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-64f0e062-c9df-4d0c-9795-b36c016f7fc1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:50.828687 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-64f0e062-c9df-4d0c-9795-b36c016f7fc1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:50.838328 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-64f0e062-c9df-4d0c-9795-b36c016f7fc1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:50.865703 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-439ffbc1-9ba7-4730-a18f-5ff7cad7ce6b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:50.875539 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-439ffbc1-9ba7-4730-a18f-5ff7cad7ce6b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.197023 Jul 26 17:17:50.876115 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 329/599] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:50 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:51.013872 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-64f0e062-c9df-4d0c-9795-b36c016f7fc1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:51.021794 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-64f0e062-c9df-4d0c-9795-b36c016f7fc1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.207179 Jul 26 17:17:51.022378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 271/600] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:50 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:51.323371 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-abf5c4a6-7b99-4587-94b0-f1b9f3db311f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:51.324839 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-abf5c4a6-7b99-4587-94b0-f1b9f3db311f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:51.327783 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:51.335883 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abf5c4a6-7b99-4587-94b0-f1b9f3db311f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:51.336656 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abf5c4a6-7b99-4587-94b0-f1b9f3db311f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:51.337725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abf5c4a6-7b99-4587-94b0-f1b9f3db311f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:51.338262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abf5c4a6-7b99-4587-94b0-f1b9f3db311f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:51.670537 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-abf5c4a6-7b99-4587-94b0-f1b9f3db311f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:51.673588 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:51.680388 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-abf5c4a6-7b99-4587-94b0-f1b9f3db311f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1260 microversion: 2.1 time: 0.361928 Jul 26 17:17:51.681076 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 330/601] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:51 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1260 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:51.900993 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c995a909-031c-46ad-97a4-2fdf9fb3912b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:51.901673 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c995a909-031c-46ad-97a4-2fdf9fb3912b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:51.911573 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c995a909-031c-46ad-97a4-2fdf9fb3912b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:51.912037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c995a909-031c-46ad-97a4-2fdf9fb3912b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:51.912873 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c995a909-031c-46ad-97a4-2fdf9fb3912b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:51.913339 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c995a909-031c-46ad-97a4-2fdf9fb3912b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:52.043158 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dc6450bb-296a-4011-baa1-1768ca274342 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:52.044505 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dc6450bb-296a-4011-baa1-1768ca274342 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:52.051808 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc6450bb-296a-4011-baa1-1768ca274342 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:52.052355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc6450bb-296a-4011-baa1-1768ca274342 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:52.053479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc6450bb-296a-4011-baa1-1768ca274342 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:52.054227 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc6450bb-296a-4011-baa1-1768ca274342 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:52.110766 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c995a909-031c-46ad-97a4-2fdf9fb3912b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:52.124735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c995a909-031c-46ad-97a4-2fdf9fb3912b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.227645 Jul 26 17:17:52.129472 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 272/602] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:51 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:52.262812 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dc6450bb-296a-4011-baa1-1768ca274342 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:52.277834 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dc6450bb-296a-4011-baa1-1768ca274342 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.237949 Jul 26 17:17:52.278933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 331/603] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:52 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:52.419970 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-c9dc70c4-6fea-49bd-8214-26b764ae5acd req-11480107-6927-468f-82bd-d068d27825d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1e9557-fc15-4ea5-9b93-de135b76dfeb", "name": "network-vif-plugged", "status": "completed", "tag": "31c721ef-3c46-4353-858f-597f80f0ca60"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:52.425497 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:52.439833 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-c9dc70c4-6fea-49bd-8214-26b764ae5acd req-11480107-6927-468f-82bd-d068d27825d3 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:52.441821 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-c9dc70c4-6fea-49bd-8214-26b764ae5acd req-11480107-6927-468f-82bd-d068d27825d3 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:52.470989 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-c9dc70c4-6fea-49bd-8214-26b764ae5acd req-11480107-6927-468f-82bd-d068d27825d3 service nova] Creating event network-vif-plugged:31c721ef-3c46-4353-858f-597f80f0ca60 for instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb on hv-cinder-83538 Jul 26 17:17:52.485156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-c9dc70c4-6fea-49bd-8214-26b764ae5acd req-11480107-6927-468f-82bd-d068d27825d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072827 Jul 26 17:17:52.486072 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 273/604] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:17:52.708769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-76beefde-dd50-4e1f-8136-cc46970841da tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:52.709347 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-76beefde-dd50-4e1f-8136-cc46970841da tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:52.723604 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76beefde-dd50-4e1f-8136-cc46970841da tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:52.725855 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76beefde-dd50-4e1f-8136-cc46970841da tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:52.727331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76beefde-dd50-4e1f-8136-cc46970841da tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:52.728049 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76beefde-dd50-4e1f-8136-cc46970841da tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:52.994259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-76beefde-dd50-4e1f-8136-cc46970841da tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:53.008932 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-76beefde-dd50-4e1f-8136-cc46970841da tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1260 microversion: 2.1 time: 0.306886 Jul 26 17:17:53.010588 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 332/605] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:52 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1260 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:53.149563 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-97a291e9-755e-422a-802f-dd047a23eb2b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:53.150508 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-97a291e9-755e-422a-802f-dd047a23eb2b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:53.158145 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-97a291e9-755e-422a-802f-dd047a23eb2b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:53.158596 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-97a291e9-755e-422a-802f-dd047a23eb2b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:53.159709 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-97a291e9-755e-422a-802f-dd047a23eb2b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:53.160160 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-97a291e9-755e-422a-802f-dd047a23eb2b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:53.314540 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-739e4788-f4ad-4ecd-8608-82e3524ed7f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:53.320048 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-739e4788-f4ad-4ecd-8608-82e3524ed7f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:53.329217 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-739e4788-f4ad-4ecd-8608-82e3524ed7f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:53.329676 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-739e4788-f4ad-4ecd-8608-82e3524ed7f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:53.330525 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-739e4788-f4ad-4ecd-8608-82e3524ed7f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:53.331133 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-739e4788-f4ad-4ecd-8608-82e3524ed7f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:53.342360 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-97a291e9-755e-422a-802f-dd047a23eb2b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:53.360534 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-97a291e9-755e-422a-802f-dd047a23eb2b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.215918 Jul 26 17:17:53.361443 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 274/606] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:53 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:53.515396 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-739e4788-f4ad-4ecd-8608-82e3524ed7f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:53.525142 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-739e4788-f4ad-4ecd-8608-82e3524ed7f1 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.216035 Jul 26 17:17:53.525730 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 333/607] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:53 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:54.033496 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c2255e5d-2538-4d01-945b-a4650882dbc9 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:54.034145 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c2255e5d-2538-4d01-945b-a4650882dbc9 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:54.041117 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c2255e5d-2538-4d01-945b-a4650882dbc9 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:54.041576 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c2255e5d-2538-4d01-945b-a4650882dbc9 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:54.042362 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c2255e5d-2538-4d01-945b-a4650882dbc9 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:54.042914 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c2255e5d-2538-4d01-945b-a4650882dbc9 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:54.223657 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c2255e5d-2538-4d01-945b-a4650882dbc9 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:54.234387 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c2255e5d-2538-4d01-945b-a4650882dbc9 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1260 microversion: 2.1 time: 0.204699 Jul 26 17:17:54.235306 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 275/608] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:54 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:54.396133 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d987f9c5-9ea1-4035-b8bb-f17144fcbd88 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:54.396133 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d987f9c5-9ea1-4035-b8bb-f17144fcbd88 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:54.407323 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d987f9c5-9ea1-4035-b8bb-f17144fcbd88 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:54.407676 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d987f9c5-9ea1-4035-b8bb-f17144fcbd88 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:54.408711 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d987f9c5-9ea1-4035-b8bb-f17144fcbd88 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:54.409583 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d987f9c5-9ea1-4035-b8bb-f17144fcbd88 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:54.463833 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e76bab5f-26f0-458f-9926-4b49ccfced99 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:54.464872 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-e76bab5f-26f0-458f-9926-4b49ccfced99 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:54.473063 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e76bab5f-26f0-458f-9926-4b49ccfced99 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:54.473635 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e76bab5f-26f0-458f-9926-4b49ccfced99 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:54.475565 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e76bab5f-26f0-458f-9926-4b49ccfced99 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:54.475565 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e76bab5f-26f0-458f-9926-4b49ccfced99 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:54.589184 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.objects.instance [None req-e76bab5f-26f0-458f-9926-4b49ccfced99 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lazy-loading 'services' on Instance uuid 87d8afff-584e-4332-bab7-9b4e4b676dd0 {{(pid=118122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:17:54.612237 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d987f9c5-9ea1-4035-b8bb-f17144fcbd88 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:54.626701 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d987f9c5-9ea1-4035-b8bb-f17144fcbd88 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.239342 Jul 26 17:17:54.627776 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 334/609] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:54 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:54.638126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-23d71673-84eb-4fc3-8db3-3dfc2c5ab53c req-fcc1bfb1-fff9-4d64-8367-92929daaf72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b93f34-9005-40dc-acb1-496c1eaf53c6", "name": "network-vif-plugged", "status": "completed", "tag": "106ac6cf-a172-4113-980c-418b8d51f6a4"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:54.651439 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-23d71673-84eb-4fc3-8db3-3dfc2c5ab53c req-fcc1bfb1-fff9-4d64-8367-92929daaf72e service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:54.652869 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-23d71673-84eb-4fc3-8db3-3dfc2c5ab53c req-fcc1bfb1-fff9-4d64-8367-92929daaf72e service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:54.675342 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-23d71673-84eb-4fc3-8db3-3dfc2c5ab53c req-fcc1bfb1-fff9-4d64-8367-92929daaf72e service nova] Creating event network-vif-plugged:106ac6cf-a172-4113-980c-418b8d51f6a4 for instance 95b93f34-9005-40dc-acb1-496c1eaf53c6 on hv-cinder-83538 Jul 26 17:17:54.681238 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-23d71673-84eb-4fc3-8db3-3dfc2c5ab53c req-fcc1bfb1-fff9-4d64-8367-92929daaf72e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051662 Jul 26 17:17:54.681782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 335/610] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:17:54.688208 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6f06ffb0-ff69-4346-a807-96d7cefa5b21 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:54.689068 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6f06ffb0-ff69-4346-a807-96d7cefa5b21 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:54.689200 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e76bab5f-26f0-458f-9926-4b49ccfced99 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "DELETE /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0/os-volume_attachments/ce6099d0-20ea-40a7-944b-a03640057ce2" status: 202 len: 0 microversion: 2.1 time: 0.229751 Jul 26 17:17:54.689736 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 276/611] 10.222.0.48 () {58 vars in 1416 bytes} [Tue Jul 26 17:17:54 2022] DELETE /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0/os-volume_attachments/ce6099d0-20ea-40a7-944b-a03640057ce2 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 17:17:54.696190 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f06ffb0-ff69-4346-a807-96d7cefa5b21 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:54.696650 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f06ffb0-ff69-4346-a807-96d7cefa5b21 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:54.697471 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f06ffb0-ff69-4346-a807-96d7cefa5b21 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:54.697905 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f06ffb0-ff69-4346-a807-96d7cefa5b21 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:54.857095 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6f06ffb0-ff69-4346-a807-96d7cefa5b21 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:54.866039 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6f06ffb0-ff69-4346-a807-96d7cefa5b21 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1366 microversion: 2.1 time: 0.183018 Jul 26 17:17:54.866869 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 336/612] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:54 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:55.283487 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-cdba72b6-4198-4ea2-a9ac-4810f9d40e91 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:55.284353 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-cdba72b6-4198-4ea2-a9ac-4810f9d40e91 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:55.298315 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cdba72b6-4198-4ea2-a9ac-4810f9d40e91 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:55.299116 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cdba72b6-4198-4ea2-a9ac-4810f9d40e91 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:55.300573 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cdba72b6-4198-4ea2-a9ac-4810f9d40e91 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:55.301381 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cdba72b6-4198-4ea2-a9ac-4810f9d40e91 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:55.482717 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-cdba72b6-4198-4ea2-a9ac-4810f9d40e91 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:55.492098 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-cdba72b6-4198-4ea2-a9ac-4810f9d40e91 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1260 microversion: 2.1 time: 0.217409 Jul 26 17:17:55.492706 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 277/613] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:55 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:55.649631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-21f1b2d5-da57-4b3f-b243-349a38426a99 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:55.650311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-21f1b2d5-da57-4b3f-b243-349a38426a99 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:55.658589 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21f1b2d5-da57-4b3f-b243-349a38426a99 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:55.659035 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21f1b2d5-da57-4b3f-b243-349a38426a99 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:55.659805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21f1b2d5-da57-4b3f-b243-349a38426a99 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:55.660240 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21f1b2d5-da57-4b3f-b243-349a38426a99 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:55.805714 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-21f1b2d5-da57-4b3f-b243-349a38426a99 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:55.814697 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-21f1b2d5-da57-4b3f-b243-349a38426a99 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.168787 Jul 26 17:17:55.815280 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 337/614] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:55 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:55.893403 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b57a9bcf-73be-4f64-9621-9450dc37a80b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:55.894195 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b57a9bcf-73be-4f64-9621-9450dc37a80b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:55.900877 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b57a9bcf-73be-4f64-9621-9450dc37a80b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:55.901304 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b57a9bcf-73be-4f64-9621-9450dc37a80b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:55.902172 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b57a9bcf-73be-4f64-9621-9450dc37a80b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:55.902591 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b57a9bcf-73be-4f64-9621-9450dc37a80b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:56.085423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-b57a9bcf-73be-4f64-9621-9450dc37a80b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:56.098459 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b57a9bcf-73be-4f64-9621-9450dc37a80b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1556 microversion: 2.1 time: 0.212314 Jul 26 17:17:56.099501 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 278/615] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:55 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1556 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:56.122301 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e016ee7e-a3fa-4e2c-b9cb-07ec25bf493f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:56.122986 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e016ee7e-a3fa-4e2c-b9cb-07ec25bf493f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:56.129025 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e016ee7e-a3fa-4e2c-b9cb-07ec25bf493f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:56.129465 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e016ee7e-a3fa-4e2c-b9cb-07ec25bf493f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:56.130243 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e016ee7e-a3fa-4e2c-b9cb-07ec25bf493f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:56.130665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e016ee7e-a3fa-4e2c-b9cb-07ec25bf493f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:56.216192 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e016ee7e-a3fa-4e2c-b9cb-07ec25bf493f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098454 Jul 26 17:17:56.216787 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 338/616] 10.222.0.48 () {58 vars in 1275 bytes} [Tue Jul 26 17:17:56 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:17:56.518099 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-14e8640b-9252-4eeb-ac16-1cdae55bb719 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:56.518998 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-14e8640b-9252-4eeb-ac16-1cdae55bb719 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:56.526507 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-14e8640b-9252-4eeb-ac16-1cdae55bb719 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:56.527265 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-14e8640b-9252-4eeb-ac16-1cdae55bb719 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:56.528744 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-14e8640b-9252-4eeb-ac16-1cdae55bb719 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:56.529554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-14e8640b-9252-4eeb-ac16-1cdae55bb719 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:56.534875 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:17:56.702453 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-14e8640b-9252-4eeb-ac16-1cdae55bb719 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:56.709871 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-14e8640b-9252-4eeb-ac16-1cdae55bb719 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1260 microversion: 2.1 time: 0.195962 Jul 26 17:17:56.710459 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 279/617] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:56 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:56.849651 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1f37c1f1-d371-44f6-b9aa-8411a9faf998 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:56.850371 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1f37c1f1-d371-44f6-b9aa-8411a9faf998 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:56.857631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f37c1f1-d371-44f6-b9aa-8411a9faf998 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:56.858853 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f37c1f1-d371-44f6-b9aa-8411a9faf998 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:56.859725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f37c1f1-d371-44f6-b9aa-8411a9faf998 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:56.860230 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f37c1f1-d371-44f6-b9aa-8411a9faf998 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:57.116949 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1f37c1f1-d371-44f6-b9aa-8411a9faf998 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:57.134781 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1f37c1f1-d371-44f6-b9aa-8411a9faf998 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.294763 Jul 26 17:17:57.135686 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 339/618] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:56 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:17:57.735302 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-980f69e4-d7dc-4105-944f-96409f960165 req-007003de-00a2-4756-bf53-7aeb255f529f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1e9557-fc15-4ea5-9b93-de135b76dfeb", "tag": "31c721ef-3c46-4353-858f-597f80f0ca60"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:17:57.735719 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-35f543f4-9f09-466a-8b1b-b4ae5671781e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:57.737517 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-35f543f4-9f09-466a-8b1b-b4ae5671781e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:57.746735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-35f543f4-9f09-466a-8b1b-b4ae5671781e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:57.747665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-980f69e4-d7dc-4105-944f-96409f960165 req-007003de-00a2-4756-bf53-7aeb255f529f service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:57.748011 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-35f543f4-9f09-466a-8b1b-b4ae5671781e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:57.748304 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-980f69e4-d7dc-4105-944f-96409f960165 req-007003de-00a2-4756-bf53-7aeb255f529f service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:57.750235 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-35f543f4-9f09-466a-8b1b-b4ae5671781e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:57.751347 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-35f543f4-9f09-466a-8b1b-b4ae5671781e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:57.763690 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-980f69e4-d7dc-4105-944f-96409f960165 req-007003de-00a2-4756-bf53-7aeb255f529f service nova] Creating event network-changed:31c721ef-3c46-4353-858f-597f80f0ca60 for instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb on hv-cinder-83538 Jul 26 17:17:57.771051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-980f69e4-d7dc-4105-944f-96409f960165 req-007003de-00a2-4756-bf53-7aeb255f529f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039416 Jul 26 17:17:57.772359 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 340/619] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:17:57.928263 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-35f543f4-9f09-466a-8b1b-b4ae5671781e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:57.939491 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-35f543f4-9f09-466a-8b1b-b4ae5671781e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1443 microversion: 2.1 time: 0.210105 Jul 26 17:17:57.942097 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 280/620] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:57 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1443 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:57.975510 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0649a004-6a9d-4292-9026-c07b9cda830f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:57.976397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0649a004-6a9d-4292-9026-c07b9cda830f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:57.985301 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0649a004-6a9d-4292-9026-c07b9cda830f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:57.985596 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0649a004-6a9d-4292-9026-c07b9cda830f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:57.986544 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0649a004-6a9d-4292-9026-c07b9cda830f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:57.986800 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0649a004-6a9d-4292-9026-c07b9cda830f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:58.027681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-517c7362-a4fc-431d-a06b-42c76fcf2503 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:58.027964 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-517c7362-a4fc-431d-a06b-42c76fcf2503 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:58.035497 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-517c7362-a4fc-431d-a06b-42c76fcf2503 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:58.035942 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-517c7362-a4fc-431d-a06b-42c76fcf2503 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:58.036859 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-517c7362-a4fc-431d-a06b-42c76fcf2503 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:58.037509 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-517c7362-a4fc-431d-a06b-42c76fcf2503 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:58.067518 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-517c7362-a4fc-431d-a06b-42c76fcf2503 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Going to try to terminate instance {{(pid=118122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:17:58.194244 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-517c7362-a4fc-431d-a06b-42c76fcf2503 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "DELETE /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 204 len: 0 microversion: 2.1 time: 0.169140 Jul 26 17:17:58.195021 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 281/621] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:17:58 2022] DELETE /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 17:17:58.201557 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b96826c0-bfa6-4142-be41-b70769b2f9ec tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:58.206887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b96826c0-bfa6-4142-be41-b70769b2f9ec tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:58.214861 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b96826c0-bfa6-4142-be41-b70769b2f9ec tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:58.215929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b96826c0-bfa6-4142-be41-b70769b2f9ec tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:58.217706 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b96826c0-bfa6-4142-be41-b70769b2f9ec tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:58.218433 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b96826c0-bfa6-4142-be41-b70769b2f9ec tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:58.347609 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0649a004-6a9d-4292-9026-c07b9cda830f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:58.358013 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0649a004-6a9d-4292-9026-c07b9cda830f tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1443 microversion: 2.1 time: 0.390180 Jul 26 17:17:58.359445 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 341/622] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:57 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1443 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:58.364503 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8535caca-5c30-4c67-8cc3-80f0cfa7479b tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:58.365132 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8535caca-5c30-4c67-8cc3-80f0cfa7479b tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:58.372817 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8535caca-5c30-4c67-8cc3-80f0cfa7479b tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:58.373573 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8535caca-5c30-4c67-8cc3-80f0cfa7479b tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:58.374779 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8535caca-5c30-4c67-8cc3-80f0cfa7479b tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:58.375372 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8535caca-5c30-4c67-8cc3-80f0cfa7479b tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:58.470533 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-b96826c0-bfa6-4142-be41-b70769b2f9ec tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:58.480849 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b96826c0-bfa6-4142-be41-b70769b2f9ec tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.283958 Jul 26 17:17:58.481733 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 282/623] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:58 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:58.622833 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8535caca-5c30-4c67-8cc3-80f0cfa7479b tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:58.627453 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8535caca-5c30-4c67-8cc3-80f0cfa7479b tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1511 microversion: 2.1 time: 0.266707 Jul 26 17:17:58.628048 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 342/624] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:58 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:59.503315 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-dee340e7-5abe-4977-af5c-b9df15267a05 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:59.503975 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-dee340e7-5abe-4977-af5c-b9df15267a05 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:59.510918 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dee340e7-5abe-4977-af5c-b9df15267a05 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:59.511558 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dee340e7-5abe-4977-af5c-b9df15267a05 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:59.512335 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dee340e7-5abe-4977-af5c-b9df15267a05 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:59.512794 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dee340e7-5abe-4977-af5c-b9df15267a05 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:59.653256 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ed800ec2-1610-4944-baeb-e70888df6bf2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:17:59.654187 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ed800ec2-1610-4944-baeb-e70888df6bf2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:17:59.662204 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed800ec2-1610-4944-baeb-e70888df6bf2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:59.662676 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed800ec2-1610-4944-baeb-e70888df6bf2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:59.663529 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed800ec2-1610-4944-baeb-e70888df6bf2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:17:59.664239 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed800ec2-1610-4944-baeb-e70888df6bf2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:17:59.683165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-dee340e7-5abe-4977-af5c-b9df15267a05 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:59.693749 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-dee340e7-5abe-4977-af5c-b9df15267a05 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.194551 Jul 26 17:17:59.694960 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 283/625] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:59 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:17:59.896813 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ed800ec2-1610-4944-baeb-e70888df6bf2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:17:59.905141 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ed800ec2-1610-4944-baeb-e70888df6bf2 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1511 microversion: 2.1 time: 0.256514 Jul 26 17:17:59.905743 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 343/626] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:17:59 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:00.543710 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-19883d11-de71-4c4f-b536-777b97237a80 req-a53d5ee2-c26a-4703-af4c-4209fd0772e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b93f34-9005-40dc-acb1-496c1eaf53c6", "tag": "106ac6cf-a172-4113-980c-418b8d51f6a4"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:00.554036 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-19883d11-de71-4c4f-b536-777b97237a80 req-a53d5ee2-c26a-4703-af4c-4209fd0772e3 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:00.554479 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-19883d11-de71-4c4f-b536-777b97237a80 req-a53d5ee2-c26a-4703-af4c-4209fd0772e3 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:00.568100 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-19883d11-de71-4c4f-b536-777b97237a80 req-a53d5ee2-c26a-4703-af4c-4209fd0772e3 service nova] Creating event network-changed:106ac6cf-a172-4113-980c-418b8d51f6a4 for instance 95b93f34-9005-40dc-acb1-496c1eaf53c6 on hv-cinder-83538 Jul 26 17:18:00.573183 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-19883d11-de71-4c4f-b536-777b97237a80 req-a53d5ee2-c26a-4703-af4c-4209fd0772e3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033609 Jul 26 17:18:00.574412 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 284/627] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:18:00.719833 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6c776a99-55d3-4e68-85f6-c3e4ea5e1dbb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:00.721267 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6c776a99-55d3-4e68-85f6-c3e4ea5e1dbb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:00.728904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c776a99-55d3-4e68-85f6-c3e4ea5e1dbb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:00.729699 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c776a99-55d3-4e68-85f6-c3e4ea5e1dbb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:00.730614 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c776a99-55d3-4e68-85f6-c3e4ea5e1dbb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:00.731056 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c776a99-55d3-4e68-85f6-c3e4ea5e1dbb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:00.942477 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-096ec222-d517-405d-9cd1-154f43f2583d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:00.943768 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-096ec222-d517-405d-9cd1-154f43f2583d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:00.952069 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-096ec222-d517-405d-9cd1-154f43f2583d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:00.952520 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-096ec222-d517-405d-9cd1-154f43f2583d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:00.953750 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-096ec222-d517-405d-9cd1-154f43f2583d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:00.954212 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-096ec222-d517-405d-9cd1-154f43f2583d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:00.956239 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6c776a99-55d3-4e68-85f6-c3e4ea5e1dbb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:00.966621 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6c776a99-55d3-4e68-85f6-c3e4ea5e1dbb tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.252663 Jul 26 17:18:00.967482 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 344/628] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:00 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:01.209470 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-096ec222-d517-405d-9cd1-154f43f2583d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:01.218957 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-096ec222-d517-405d-9cd1-154f43f2583d tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1511 microversion: 2.1 time: 0.281512 Jul 26 17:18:01.220171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 285/629] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:00 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1511 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:01.988102 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aff6c1f1-8465-4a7e-a97f-d793b6694513 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:01.988731 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aff6c1f1-8465-4a7e-a97f-d793b6694513 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:01.995994 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aff6c1f1-8465-4a7e-a97f-d793b6694513 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:01.996520 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aff6c1f1-8465-4a7e-a97f-d793b6694513 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:01.997402 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aff6c1f1-8465-4a7e-a97f-d793b6694513 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:01.997844 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aff6c1f1-8465-4a7e-a97f-d793b6694513 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:02.247135 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a4560acd-3535-4dc2-ab39-527883170a21 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:02.248204 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a4560acd-3535-4dc2-ab39-527883170a21 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:02.258756 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a4560acd-3535-4dc2-ab39-527883170a21 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:02.259317 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a4560acd-3535-4dc2-ab39-527883170a21 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:02.260552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a4560acd-3535-4dc2-ab39-527883170a21 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:02.260638 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a4560acd-3535-4dc2-ab39-527883170a21 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:02.319128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-aff6c1f1-8465-4a7e-a97f-d793b6694513 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:02.330117 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aff6c1f1-8465-4a7e-a97f-d793b6694513 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.345683 Jul 26 17:18:02.331109 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 345/630] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:01 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:02.514778 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a4560acd-3535-4dc2-ab39-527883170a21 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:02.524405 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a4560acd-3535-4dc2-ab39-527883170a21 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1511 microversion: 2.1 time: 0.284439 Jul 26 17:18:02.525378 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 286/631] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:02 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1511 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:02.665961 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-dffcce47-0f7f-4564-b3a8-da00ea0127d4 req-e9ac0443-e29c-4d4d-ba2e-cddf61dc5a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d8afff-584e-4332-bab7-9b4e4b676dd0", "name": "network-vif-deleted", "tag": "fc687e56-c81d-4933-8a74-eb1550ca516f"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:02.676455 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-dffcce47-0f7f-4564-b3a8-da00ea0127d4 req-e9ac0443-e29c-4d4d-ba2e-cddf61dc5a62 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:02.676878 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-dffcce47-0f7f-4564-b3a8-da00ea0127d4 req-e9ac0443-e29c-4d4d-ba2e-cddf61dc5a62 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:02.688252 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-dffcce47-0f7f-4564-b3a8-da00ea0127d4 req-e9ac0443-e29c-4d4d-ba2e-cddf61dc5a62 service nova] Creating event network-vif-deleted:fc687e56-c81d-4933-8a74-eb1550ca516f for instance 87d8afff-584e-4332-bab7-9b4e4b676dd0 on hv-cinder-83538 Jul 26 17:18:02.693158 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-dffcce47-0f7f-4564-b3a8-da00ea0127d4 req-e9ac0443-e29c-4d4d-ba2e-cddf61dc5a62 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030856 Jul 26 17:18:02.693756 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 346/632] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:18:03.371124 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0cc6217e-7c14-4075-b5c1-945a3a53404f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:03.372772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0cc6217e-7c14-4075-b5c1-945a3a53404f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:03.380899 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0cc6217e-7c14-4075-b5c1-945a3a53404f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:03.381436 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0cc6217e-7c14-4075-b5c1-945a3a53404f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:03.382426 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0cc6217e-7c14-4075-b5c1-945a3a53404f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:03.382979 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0cc6217e-7c14-4075-b5c1-945a3a53404f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:03.570374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e43815f4-a73a-4192-ba5f-4aa3b26f44bd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:03.582665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e43815f4-a73a-4192-ba5f-4aa3b26f44bd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:03.612747 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0cc6217e-7c14-4075-b5c1-945a3a53404f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:03.616444 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e43815f4-a73a-4192-ba5f-4aa3b26f44bd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:03.621962 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e43815f4-a73a-4192-ba5f-4aa3b26f44bd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:03.626762 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0cc6217e-7c14-4075-b5c1-945a3a53404f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.263990 Jul 26 17:18:03.644172 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 287/633] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:03 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:03.645073 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e43815f4-a73a-4192-ba5f-4aa3b26f44bd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:03.657070 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e43815f4-a73a-4192-ba5f-4aa3b26f44bd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:03.776152 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1931667640", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1393964861", "security_groups": [{"name": "tempest-secgroup-smoke-1628658040"}], "block_device_mapping_v2": [{"uuid": "e6530c00-c722-4269-b83b-8f60bd1f2729", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dc0fe413-bc4b-4401-bb71-d74110a1081f"}]}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:03.880797 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e43815f4-a73a-4192-ba5f-4aa3b26f44bd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:03.891270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e43815f4-a73a-4192-ba5f-4aa3b26f44bd tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1303 microversion: 2.1 time: 0.333385 Jul 26 17:18:03.901477 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 347/634] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:03 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1303 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:03.955045 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.network.neutron [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] validate_networks() for [('dc0fe413-bc4b-4401-bb71-d74110a1081f', None, None, None, None, None)] {{(pid=118122) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:18:04.389553 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Flavor limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:18:04.390355 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Image limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:18:04.390874 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Flavor pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:18:04.391278 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Image pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:18:04.391682 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:18:04.402814 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:04.403268 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:04.404080 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:04.404512 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:04.425216 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Getting quotas for project b888b1053bb043dbb88d674c9a504a86. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:18:04.429311 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Getting quotas for user dcf968aeb53c4215927642e9931b4a5e and project b888b1053bb043dbb88d674c9a504a86. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:18:04.501421 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Going to run 1 instances... {{(pid=118122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:18:04.505469 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6530c00-c722-4269-b83b-8f60bd1f2729',volume_size=None,volume_type=None)] {{(pid=118122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:18:04.677438 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-526ef4ac-c333-4997-9a6d-e70b52762955 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:04.678290 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-526ef4ac-c333-4997-9a6d-e70b52762955 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:04.683994 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0367d42b-a2b7-493d-8bb4-0c0d89015ae0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.911727 Jul 26 17:18:04.684930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 288/635] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:18:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 17:18:04.695234 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-526ef4ac-c333-4997-9a6d-e70b52762955 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:04.697026 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1c64a98f-36d2-40c3-bede-7dfa9de63a96 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:04.698075 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1c64a98f-36d2-40c3-bede-7dfa9de63a96 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:04.699119 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-526ef4ac-c333-4997-9a6d-e70b52762955 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:04.699479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-526ef4ac-c333-4997-9a6d-e70b52762955 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:04.699921 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-526ef4ac-c333-4997-9a6d-e70b52762955 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:04.787623 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1c64a98f-36d2-40c3-bede-7dfa9de63a96 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:04.796810 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1c64a98f-36d2-40c3-bede-7dfa9de63a96 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1095 microversion: 2.1 time: 0.104496 Jul 26 17:18:04.797730 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 289/636] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:04 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:04.874454 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-526ef4ac-c333-4997-9a6d-e70b52762955 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:04.883823 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-526ef4ac-c333-4997-9a6d-e70b52762955 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1737 microversion: 2.1 time: 0.210435 Jul 26 17:18:04.884413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 348/637] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:04 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:04.915345 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5a587d18-39d2-498a-b138-3a7737120f44 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:04.916544 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5a587d18-39d2-498a-b138-3a7737120f44 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:04.927118 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5a587d18-39d2-498a-b138-3a7737120f44 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:04.927874 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5a587d18-39d2-498a-b138-3a7737120f44 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:04.929292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5a587d18-39d2-498a-b138-3a7737120f44 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:04.930038 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5a587d18-39d2-498a-b138-3a7737120f44 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:04.987458 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5a587d18-39d2-498a-b138-3a7737120f44 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:04.988112 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5a587d18-39d2-498a-b138-3a7737120f44 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:04.988794 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.objects.instance [None req-5a587d18-39d2-498a-b138-3a7737120f44 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lazy-loading 'fault' on Instance uuid 87d8afff-584e-4332-bab7-9b4e4b676dd0 {{(pid=118122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:18:05.076763 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5a587d18-39d2-498a-b138-3a7737120f44 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d951f022d244c348e045966c33d5663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd379bf9c35444978b63c8a5a1e337928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:05.096046 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5a587d18-39d2-498a-b138-3a7737120f44 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 200 len: 1308 microversion: 2.1 time: 0.184953 Jul 26 17:18:05.096595 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 290/638] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:04 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 1308 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:05.821856 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-880627dd-ea17-4b97-8928-a006a51e0f8b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:05.822467 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-880627dd-ea17-4b97-8928-a006a51e0f8b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:05.829430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-880627dd-ea17-4b97-8928-a006a51e0f8b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:05.829877 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-880627dd-ea17-4b97-8928-a006a51e0f8b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:05.830642 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-880627dd-ea17-4b97-8928-a006a51e0f8b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:05.831144 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-880627dd-ea17-4b97-8928-a006a51e0f8b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:05.902859 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-880627dd-ea17-4b97-8928-a006a51e0f8b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:05.906884 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:05.914962 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c95e18ad-3a29-4baa-9c40-a78962e5c284 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:05.915790 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-880627dd-ea17-4b97-8928-a006a51e0f8b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1145 microversion: 2.1 time: 0.097219 Jul 26 17:18:05.916429 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c95e18ad-3a29-4baa-9c40-a78962e5c284 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:05.921159 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 349/639] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:05 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1145 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:05.924358 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c95e18ad-3a29-4baa-9c40-a78962e5c284 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:05.925210 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c95e18ad-3a29-4baa-9c40-a78962e5c284 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:05.926892 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c95e18ad-3a29-4baa-9c40-a78962e5c284 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:05.926892 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c95e18ad-3a29-4baa-9c40-a78962e5c284 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:06.100727 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c95e18ad-3a29-4baa-9c40-a78962e5c284 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:06.110564 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c95e18ad-3a29-4baa-9c40-a78962e5c284 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1717 microversion: 2.1 time: 0.201545 Jul 26 17:18:06.111680 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 291/640] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:05 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1717 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:06.126722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9d091e18-0946-4e2a-bd24-da7267889545 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:06.128882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9d091e18-0946-4e2a-bd24-da7267889545 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] [instance: 87d8afff-584e-4332-bab7-9b4e4b676dd0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:06.139403 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d091e18-0946-4e2a-bd24-da7267889545 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:06.139670 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d091e18-0946-4e2a-bd24-da7267889545 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:06.140934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d091e18-0946-4e2a-bd24-da7267889545 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:06.141549 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d091e18-0946-4e2a-bd24-da7267889545 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:06.161940 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-9d091e18-0946-4e2a-bd24-da7267889545 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] HTTP exception thrown: Instance 87d8afff-584e-4332-bab7-9b4e4b676dd0 could not be found. Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9d091e18-0946-4e2a-bd24-da7267889545 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Request method failure captured: Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 HTTP/1.1 Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CEXSJLv3ijl1TN_hJz0EKpUbnioCO-lpvHWQyoGalaGQrhGodsHfmRFUl9xOcaKmvqrFJHSfAUyHgpDLJoVDVOl3fE8W32HDLKHISZa7MZYbuDiGHomqpwMO9p3R30QFMxuWBGznhBwic0RXL1CQWro9ZjQisAjb5qN6WRpUPwbaLM Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: d379bf9c35444978b63c8a5a1e337928 Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesSnapshotTestJSON-867891461 Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:18:06.165155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:18:06.166863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d379bf9c35444978b63c8a5a1e337928"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d379bf9c35444978b63c8a5a1e337928"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d379bf9c35444978b63c8a5a1e337928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d379bf9c35444978b63c8a5a1e337928"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:18:06.166863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesSnapshotTestJSON-867891461 Jul 26 17:18:06.166863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: d379bf9c35444978b63c8a5a1e337928 Jul 26 17:18:06.166863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-867891461 Jul 26 17:18:06.166863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesSnapshotTestJSON-867891461-project Jul 26 17:18:06.166863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:18:06.166863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:18:06.166863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: 9d951f022d244c348e045966c33d5663 Jul 26 17:18:06.166863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesSnapshotTestJSON-867891461-project Jul 26 17:18:06.166863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:18:06.166863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance 87d8afff-584e-4332-bab7-9b4e4b676dd0 could not be found. Jul 26 17:18:06.166863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '87d8afff-584e-4332-bab7-9b4e4b676dd0'} Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d8afff-584e-4332-bab7-9b4e4b676dd0 could not be found. Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:18:06.168122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d8afff-584e-4332-bab7-9b4e4b676dd0 could not be found. Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d8afff-584e-4332-bab7-9b4e4b676dd0 could not be found. Jul 26 17:18:06.170155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:18:06.172978 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9d091e18-0946-4e2a-bd24-da7267889545 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] Returning 404 to user: Instance 87d8afff-584e-4332-bab7-9b4e4b676dd0 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:18:06.174036 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9d091e18-0946-4e2a-bd24-da7267889545 tempest-VolumesSnapshotTestJSON-867891461 tempest-VolumesSnapshotTestJSON-867891461-project] 10.222.0.48 "GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0" status: 404 len: 111 microversion: 2.1 time: 0.053286 Jul 26 17:18:06.174612 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 350/641] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:06 2022] GET /compute/v2.1/servers/87d8afff-584e-4332-bab7-9b4e4b676dd0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:18:06.301407 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4766669f-fd96-4601-9898-3996396b96b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:06.302062 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4766669f-fd96-4601-9898-3996396b96b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:06.309335 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4766669f-fd96-4601-9898-3996396b96b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:06.310032 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4766669f-fd96-4601-9898-3996396b96b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:06.310945 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4766669f-fd96-4601-9898-3996396b96b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:06.311491 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4766669f-fd96-4601-9898-3996396b96b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:06.420830 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-4766669f-fd96-4601-9898-3996396b96b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] HTTP exception thrown: Cannot 'detach_volume' instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce while it is in vm_state rescued Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4766669f-fd96-4601-9898-3996396b96b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Request method failure captured: Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: DELETE /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments/aca78baa-aea6-4863-b4f5-7b62d8825346 HTTP/1.1 Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CC2x0eKkH9UXJgkwe-DjkCoDqloc4SydbPTIUNwkQQ0_-ouZD4LJcioqLwoynbj5fwOQ8ZgXQWu3c-hjOZFFvdgy6I-P1cEeLqhJgW3KkQqc5QCS1kbQ00kpGZ1KpgwuursPfQkB8oQIc4wtw4pQzOfyKY8lCWGfdT8KOsp-1vwtAw Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 2b8b6c88af94417c840fdafd1fe431b7 Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:18:06.422774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:18:06.424636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:18:06.424636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:18:06.424636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 2b8b6c88af94417c840fdafd1fe431b7 Jul 26 17:18:06.424636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:18:06.424636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-ServerRescueNegativeTestJSON-894760419-project Jul 26 17:18:06.424636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:18:06.424636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:18:06.424636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: 97115d07acc5464bb7b097039471fee6 Jul 26 17:18:06.424636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894760419-project Jul 26 17:18:06.424636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:18:06.424636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Cannot 'detach_volume' instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce while it is in vm_state rescued Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'server_id': '7701e238-d4bd-4e91-9ae9-9a5845f8a1ce', 'id': 'aca78baa-aea6-4863-b4f5-7b62d8825346'} Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:18:06.426050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce while it is in vm_state rescued Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce while it is in vm_state rescued Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:06.427575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4766669f-fd96-4601-9898-3996396b96b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Returning 409 to user: Cannot 'detach_volume' instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce while it is in vm_state rescued {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:18:06.429192 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4766669f-fd96-4601-9898-3996396b96b6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments/aca78baa-aea6-4863-b4f5-7b62d8825346" status: 409 len: 152 microversion: 2.1 time: 0.128132 Jul 26 17:18:06.429192 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 292/642] 10.222.0.48 () {58 vars in 1416 bytes} [Tue Jul 26 17:18:06 2022] DELETE /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments/aca78baa-aea6-4863-b4f5-7b62d8825346 => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 17:18:06.439684 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-229b24da-2af8-40fa-9258-8708ff6654ad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:06.440439 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-229b24da-2af8-40fa-9258-8708ff6654ad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:06.449598 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-229b24da-2af8-40fa-9258-8708ff6654ad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:06.450049 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-229b24da-2af8-40fa-9258-8708ff6654ad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:06.451052 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-229b24da-2af8-40fa-9258-8708ff6654ad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:06.451537 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-229b24da-2af8-40fa-9258-8708ff6654ad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:06.567396 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-229b24da-2af8-40fa-9258-8708ff6654ad tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "POST /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/action" status: 202 len: 0 microversion: 2.1 time: 0.132860 Jul 26 17:18:06.569151 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 351/643] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:18:06 2022] POST /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:18:06.581656 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-34572e9c-b2b1-4a64-8cdc-92700e89c769 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:06.582802 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-34572e9c-b2b1-4a64-8cdc-92700e89c769 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:06.593474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-34572e9c-b2b1-4a64-8cdc-92700e89c769 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:06.594232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-34572e9c-b2b1-4a64-8cdc-92700e89c769 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:06.595228 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-34572e9c-b2b1-4a64-8cdc-92700e89c769 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:06.595952 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-34572e9c-b2b1-4a64-8cdc-92700e89c769 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:06.763738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-34572e9c-b2b1-4a64-8cdc-92700e89c769 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:06.774057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-34572e9c-b2b1-4a64-8cdc-92700e89c769 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1725 microversion: 2.1 time: 0.198272 Jul 26 17:18:06.775563 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 293/644] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:06 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:06.938743 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8f33475a-1611-4e76-86a2-c1768d5216f0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:06.939518 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8f33475a-1611-4e76-86a2-c1768d5216f0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:06.948076 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f33475a-1611-4e76-86a2-c1768d5216f0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:06.948543 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f33475a-1611-4e76-86a2-c1768d5216f0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:06.949565 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f33475a-1611-4e76-86a2-c1768d5216f0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:06.950048 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f33475a-1611-4e76-86a2-c1768d5216f0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:07.048128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8f33475a-1611-4e76-86a2-c1768d5216f0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:07.057176 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8f33475a-1611-4e76-86a2-c1768d5216f0 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1211 microversion: 2.1 time: 0.123995 Jul 26 17:18:07.058610 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 352/645] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:06 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1211 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:07.807250 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-71aafd62-66c3-45bb-9557-0a4574a8f6c8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:07.808497 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-71aafd62-66c3-45bb-9557-0a4574a8f6c8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:07.824678 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-71aafd62-66c3-45bb-9557-0a4574a8f6c8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:07.826866 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-71aafd62-66c3-45bb-9557-0a4574a8f6c8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:07.829664 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-71aafd62-66c3-45bb-9557-0a4574a8f6c8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:07.837037 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-71aafd62-66c3-45bb-9557-0a4574a8f6c8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:08.068834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-71aafd62-66c3-45bb-9557-0a4574a8f6c8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:08.081665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b3e46793-e620-4ff0-9edc-ea22debf229d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:08.082275 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-71aafd62-66c3-45bb-9557-0a4574a8f6c8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1725 microversion: 2.1 time: 0.278871 Jul 26 17:18:08.083991 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b3e46793-e620-4ff0-9edc-ea22debf229d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:08.095859 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 294/646] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:07 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:08.097688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3e46793-e620-4ff0-9edc-ea22debf229d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:08.097688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3e46793-e620-4ff0-9edc-ea22debf229d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:08.098567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3e46793-e620-4ff0-9edc-ea22debf229d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:08.099194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3e46793-e620-4ff0-9edc-ea22debf229d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:08.299948 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b3e46793-e620-4ff0-9edc-ea22debf229d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:08.309107 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b3e46793-e620-4ff0-9edc-ea22debf229d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.231733 Jul 26 17:18:08.309811 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 353/647] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:08 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:09.108228 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-727960cc-c249-44b8-89bb-3a320133b34e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:09.108926 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-727960cc-c249-44b8-89bb-3a320133b34e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:09.115556 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-727960cc-c249-44b8-89bb-3a320133b34e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:09.116002 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-727960cc-c249-44b8-89bb-3a320133b34e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:09.116778 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-727960cc-c249-44b8-89bb-3a320133b34e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:09.117249 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-727960cc-c249-44b8-89bb-3a320133b34e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:09.263625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-727960cc-c249-44b8-89bb-3a320133b34e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:09.271813 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-727960cc-c249-44b8-89bb-3a320133b34e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1725 microversion: 2.1 time: 0.167671 Jul 26 17:18:09.272393 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 295/648] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:09 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:09.331820 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b2eb6cf5-f032-417a-9d1e-af66bac1de0f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:09.332552 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b2eb6cf5-f032-417a-9d1e-af66bac1de0f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:09.339967 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b2eb6cf5-f032-417a-9d1e-af66bac1de0f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:09.340434 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b2eb6cf5-f032-417a-9d1e-af66bac1de0f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:09.341264 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b2eb6cf5-f032-417a-9d1e-af66bac1de0f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:09.341777 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b2eb6cf5-f032-417a-9d1e-af66bac1de0f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:09.488688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b2eb6cf5-f032-417a-9d1e-af66bac1de0f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:09.496863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b2eb6cf5-f032-417a-9d1e-af66bac1de0f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.169138 Jul 26 17:18:09.497463 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 354/649] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:09 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:10.091818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c1d6b631-e20a-4a18-88d2-23990241675a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:10.092318 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c1d6b631-e20a-4a18-88d2-23990241675a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:10.098861 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1d6b631-e20a-4a18-88d2-23990241675a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:10.099313 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1d6b631-e20a-4a18-88d2-23990241675a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:10.100094 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1d6b631-e20a-4a18-88d2-23990241675a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:10.100565 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1d6b631-e20a-4a18-88d2-23990241675a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:10.103461 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:10.135360 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c1d6b631-e20a-4a18-88d2-23990241675a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments/a8b69d8a-3197-4ffe-81fd-8e44b13ae74f" status: 200 len: 194 microversion: 2.20 time: 0.048239 Jul 26 17:18:10.136937 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 296/650] 10.222.0.48 () {60 vars in 1454 bytes} [Tue Jul 26 17:18:10 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments/a8b69d8a-3197-4ffe-81fd-8e44b13ae74f => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:18:10.206059 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0d39db26-4a94-487c-a739-0e29bfc92455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:10.206553 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0d39db26-4a94-487c-a739-0e29bfc92455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:10.212782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d39db26-4a94-487c-a739-0e29bfc92455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:10.213251 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d39db26-4a94-487c-a739-0e29bfc92455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:10.214020 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d39db26-4a94-487c-a739-0e29bfc92455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:10.214552 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d39db26-4a94-487c-a739-0e29bfc92455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:10.293843 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b685bc7d-84dd-4597-9c9a-afdca2476a18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:10.294455 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b685bc7d-84dd-4597-9c9a-afdca2476a18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:10.299033 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-0d39db26-4a94-487c-a739-0e29bfc92455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lazy-loading 'services' on Instance uuid 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:18:10.301341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b685bc7d-84dd-4597-9c9a-afdca2476a18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:10.301796 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b685bc7d-84dd-4597-9c9a-afdca2476a18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:10.302573 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b685bc7d-84dd-4597-9c9a-afdca2476a18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:10.303014 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b685bc7d-84dd-4597-9c9a-afdca2476a18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:10.377685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0d39db26-4a94-487c-a739-0e29bfc92455 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments/a8b69d8a-3197-4ffe-81fd-8e44b13ae74f" status: 202 len: 0 microversion: 2.20 time: 0.175359 Jul 26 17:18:10.378434 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 355/651] 10.222.0.48 () {60 vars in 1457 bytes} [Tue Jul 26 17:18:10 2022] DELETE /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments/a8b69d8a-3197-4ffe-81fd-8e44b13ae74f => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:18:10.388077 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-23b4ca99-753e-42da-a8cd-7122c3fcf4b7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:10.389846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-23b4ca99-753e-42da-a8cd-7122c3fcf4b7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:10.396410 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23b4ca99-753e-42da-a8cd-7122c3fcf4b7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:10.396859 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23b4ca99-753e-42da-a8cd-7122c3fcf4b7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:10.398125 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23b4ca99-753e-42da-a8cd-7122c3fcf4b7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:10.398564 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23b4ca99-753e-42da-a8cd-7122c3fcf4b7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:10.430050 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-23b4ca99-753e-42da-a8cd-7122c3fcf4b7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047094 Jul 26 17:18:10.430630 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 356/652] 10.222.0.48 () {60 vars in 1343 bytes} [Tue Jul 26 17:18:10 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 17:18:10.445589 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-b685bc7d-84dd-4597-9c9a-afdca2476a18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:10.453899 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b685bc7d-84dd-4597-9c9a-afdca2476a18 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1725 microversion: 2.1 time: 0.164560 Jul 26 17:18:10.454506 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 297/653] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:10 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:10.518589 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0ae7334f-f4e1-4c05-87aa-83e51fe2eb15 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:10.519102 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0ae7334f-f4e1-4c05-87aa-83e51fe2eb15 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:10.525408 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ae7334f-f4e1-4c05-87aa-83e51fe2eb15 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:10.525851 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ae7334f-f4e1-4c05-87aa-83e51fe2eb15 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:10.526929 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ae7334f-f4e1-4c05-87aa-83e51fe2eb15 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:10.527336 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ae7334f-f4e1-4c05-87aa-83e51fe2eb15 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:10.672705 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0ae7334f-f4e1-4c05-87aa-83e51fe2eb15 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:10.680347 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0ae7334f-f4e1-4c05-87aa-83e51fe2eb15 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.165654 Jul 26 17:18:10.680920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 357/654] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:10 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:11.443976 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-29de62d0-61f6-4f6c-91ae-d4a53bc791f8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:11.446427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-29de62d0-61f6-4f6c-91ae-d4a53bc791f8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:11.454108 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-29de62d0-61f6-4f6c-91ae-d4a53bc791f8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:11.454567 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-29de62d0-61f6-4f6c-91ae-d4a53bc791f8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:11.455354 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-29de62d0-61f6-4f6c-91ae-d4a53bc791f8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:11.455793 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-29de62d0-61f6-4f6c-91ae-d4a53bc791f8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:11.476250 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2fead90e-0047-4005-a6e0-229a628158b9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:11.477396 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2fead90e-0047-4005-a6e0-229a628158b9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:11.484922 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fead90e-0047-4005-a6e0-229a628158b9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:11.485469 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fead90e-0047-4005-a6e0-229a628158b9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:11.486270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fead90e-0047-4005-a6e0-229a628158b9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:11.486705 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fead90e-0047-4005-a6e0-229a628158b9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:11.491035 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-29de62d0-61f6-4f6c-91ae-d4a53bc791f8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051179 Jul 26 17:18:11.491865 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 298/655] 10.222.0.48 () {60 vars in 1343 bytes} [Tue Jul 26 17:18:11 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:18:11.636357 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2fead90e-0047-4005-a6e0-229a628158b9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:11.644424 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2fead90e-0047-4005-a6e0-229a628158b9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1725 microversion: 2.1 time: 0.172425 Jul 26 17:18:11.645071 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 358/656] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:11 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:11.702764 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-fd391359-a95f-4562-8c87-0182ef723bde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:11.703295 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-fd391359-a95f-4562-8c87-0182ef723bde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:11.709758 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd391359-a95f-4562-8c87-0182ef723bde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:11.710206 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd391359-a95f-4562-8c87-0182ef723bde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:11.710986 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd391359-a95f-4562-8c87-0182ef723bde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:11.711432 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd391359-a95f-4562-8c87-0182ef723bde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:11.869395 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-fd391359-a95f-4562-8c87-0182ef723bde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:11.878869 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-fd391359-a95f-4562-8c87-0182ef723bde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.180224 Jul 26 17:18:11.879575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 299/657] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:11 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:12.507523 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aec58278-c4bd-4fe4-bd3e-1f363822b3d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:12.512034 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aec58278-c4bd-4fe4-bd3e-1f363822b3d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:12.522625 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aec58278-c4bd-4fe4-bd3e-1f363822b3d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:12.523670 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aec58278-c4bd-4fe4-bd3e-1f363822b3d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:12.525080 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aec58278-c4bd-4fe4-bd3e-1f363822b3d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:12.525811 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aec58278-c4bd-4fe4-bd3e-1f363822b3d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:12.580711 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aec58278-c4bd-4fe4-bd3e-1f363822b3d2 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079277 Jul 26 17:18:12.581528 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 359/658] 10.222.0.48 () {60 vars in 1343 bytes} [Tue Jul 26 17:18:12 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:18:12.667384 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6d310b71-2ee4-4649-9f7b-12e937ea344d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:12.668008 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6d310b71-2ee4-4649-9f7b-12e937ea344d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:12.675529 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6d310b71-2ee4-4649-9f7b-12e937ea344d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:12.676119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6d310b71-2ee4-4649-9f7b-12e937ea344d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:12.677139 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6d310b71-2ee4-4649-9f7b-12e937ea344d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:12.677816 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6d310b71-2ee4-4649-9f7b-12e937ea344d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:12.820270 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6d310b71-2ee4-4649-9f7b-12e937ea344d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:12.830677 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6d310b71-2ee4-4649-9f7b-12e937ea344d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1725 microversion: 2.1 time: 0.167191 Jul 26 17:18:12.831554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 300/659] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:12 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:12.904843 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a06bd4a6-3ad6-4c9a-b9b7-71ceff92077b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:12.905503 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a06bd4a6-3ad6-4c9a-b9b7-71ceff92077b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:12.911829 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a06bd4a6-3ad6-4c9a-b9b7-71ceff92077b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:12.912287 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a06bd4a6-3ad6-4c9a-b9b7-71ceff92077b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:12.913099 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a06bd4a6-3ad6-4c9a-b9b7-71ceff92077b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:12.913544 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a06bd4a6-3ad6-4c9a-b9b7-71ceff92077b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:13.139286 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a06bd4a6-3ad6-4c9a-b9b7-71ceff92077b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:13.149103 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a06bd4a6-3ad6-4c9a-b9b7-71ceff92077b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.248634 Jul 26 17:18:13.149815 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 360/660] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:12 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:13.203721 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-b6f5f5ca-b656-4e12-8702-916c00b0ed22 req-26eb7997-ee08-4207-ba21-e19443149b64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba8d6de-7d63-4f9a-be56-ff498118e97c", "tag": "2da04427-a247-4f2b-8fae-9dd8d6672da1"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:13.217770 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-b6f5f5ca-b656-4e12-8702-916c00b0ed22 req-26eb7997-ee08-4207-ba21-e19443149b64 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:13.218477 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-b6f5f5ca-b656-4e12-8702-916c00b0ed22 req-26eb7997-ee08-4207-ba21-e19443149b64 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:13.236025 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-b6f5f5ca-b656-4e12-8702-916c00b0ed22 req-26eb7997-ee08-4207-ba21-e19443149b64 service nova] Creating event network-changed:2da04427-a247-4f2b-8fae-9dd8d6672da1 for instance eba8d6de-7d63-4f9a-be56-ff498118e97c on hv-cinder-83538 Jul 26 17:18:13.241336 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-b6f5f5ca-b656-4e12-8702-916c00b0ed22 req-26eb7997-ee08-4207-ba21-e19443149b64 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047062 Jul 26 17:18:13.242212 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 301/661] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:18:13.596833 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-243b04a0-714b-457f-a744-79675dea73be tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:13.599977 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-243b04a0-714b-457f-a744-79675dea73be tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:13.608524 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-243b04a0-714b-457f-a744-79675dea73be tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:13.609146 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-243b04a0-714b-457f-a744-79675dea73be tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:13.609990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-243b04a0-714b-457f-a744-79675dea73be tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:13.611246 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-243b04a0-714b-457f-a744-79675dea73be tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:13.649978 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-243b04a0-714b-457f-a744-79675dea73be tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059965 Jul 26 17:18:13.650904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 361/662] 10.222.0.48 () {60 vars in 1343 bytes} [Tue Jul 26 17:18:13 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:18:13.856498 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c42dc00e-71ca-4201-9104-0f289e7bcff8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:13.858854 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c42dc00e-71ca-4201-9104-0f289e7bcff8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:13.866945 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c42dc00e-71ca-4201-9104-0f289e7bcff8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:13.867783 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c42dc00e-71ca-4201-9104-0f289e7bcff8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:13.868898 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c42dc00e-71ca-4201-9104-0f289e7bcff8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:13.869685 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c42dc00e-71ca-4201-9104-0f289e7bcff8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:14.027684 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c42dc00e-71ca-4201-9104-0f289e7bcff8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:14.037636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c42dc00e-71ca-4201-9104-0f289e7bcff8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1731 microversion: 2.1 time: 0.186119 Jul 26 17:18:14.038180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 302/663] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:13 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:14.065541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-29a69e66-8cc3-467f-80e3-3e4742477c59 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:14.066684 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-29a69e66-8cc3-467f-80e3-3e4742477c59 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:14.074390 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29a69e66-8cc3-467f-80e3-3e4742477c59 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:14.074876 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29a69e66-8cc3-467f-80e3-3e4742477c59 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:14.075695 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29a69e66-8cc3-467f-80e3-3e4742477c59 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:14.076250 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29a69e66-8cc3-467f-80e3-3e4742477c59 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:14.174949 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5a4a65a6-047a-440d-b937-d292eab41abf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:14.175706 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5a4a65a6-047a-440d-b937-d292eab41abf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:14.182941 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5a4a65a6-047a-440d-b937-d292eab41abf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:14.184735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5a4a65a6-047a-440d-b937-d292eab41abf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:14.185841 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5a4a65a6-047a-440d-b937-d292eab41abf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:14.186288 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5a4a65a6-047a-440d-b937-d292eab41abf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:14.198535 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-29a69e66-8cc3-467f-80e3-3e4742477c59 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140146 Jul 26 17:18:14.199327 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 362/664] 10.222.0.48 () {58 vars in 1275 bytes} [Tue Jul 26 17:18:14 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:18:14.412153 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:14.527512 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5a4a65a6-047a-440d-b937-d292eab41abf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:14.537014 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5a4a65a6-047a-440d-b937-d292eab41abf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.366896 Jul 26 17:18:14.537613 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 303/665] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:14 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:14.663639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-05afb45f-f4b4-431e-ae72-bce3182ff4ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:14.666215 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-05afb45f-f4b4-431e-ae72-bce3182ff4ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:14.673375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05afb45f-f4b4-431e-ae72-bce3182ff4ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:14.673846 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05afb45f-f4b4-431e-ae72-bce3182ff4ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:14.675075 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05afb45f-f4b4-431e-ae72-bce3182ff4ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:14.675209 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05afb45f-f4b4-431e-ae72-bce3182ff4ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:14.707171 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-05afb45f-f4b4-431e-ae72-bce3182ff4ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048303 Jul 26 17:18:14.707865 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 363/666] 10.222.0.48 () {60 vars in 1343 bytes} [Tue Jul 26 17:18:14 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:14.790842 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-07ed6149-cf34-4318-a053-d16ef4e01777 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:14.791471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-07ed6149-cf34-4318-a053-d16ef4e01777 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:14.801531 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=8 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:14.804361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-07ed6149-cf34-4318-a053-d16ef4e01777 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:14.804932 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-07ed6149-cf34-4318-a053-d16ef4e01777 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:14.805767 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-07ed6149-cf34-4318-a053-d16ef4e01777 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:14.806201 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-07ed6149-cf34-4318-a053-d16ef4e01777 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:14.849654 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-07ed6149-cf34-4318-a053-d16ef4e01777 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Going to try to terminate instance {{(pid=118122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:18:14.973923 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-07ed6149-cf34-4318-a053-d16ef4e01777 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 204 len: 0 microversion: 2.20 time: 0.187002 Jul 26 17:18:14.973923 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 304/667] 10.222.0.48 () {60 vars in 1280 bytes} [Tue Jul 26 17:18:14 2022] DELETE /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 17:18:14.984663 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-468f187a-0246-4776-9b55-6617c61a6b43 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:14.986163 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-468f187a-0246-4776-9b55-6617c61a6b43 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:14.997164 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-468f187a-0246-4776-9b55-6617c61a6b43 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:14.998335 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-468f187a-0246-4776-9b55-6617c61a6b43 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:15.000341 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-468f187a-0246-4776-9b55-6617c61a6b43 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:15.001502 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-468f187a-0246-4776-9b55-6617c61a6b43 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:15.290290 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-468f187a-0246-4776-9b55-6617c61a6b43 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:15.301898 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-468f187a-0246-4776-9b55-6617c61a6b43 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:15.304158 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-468f187a-0246-4776-9b55-6617c61a6b43 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:15.305659 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-468f187a-0246-4776-9b55-6617c61a6b43 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.324790 Jul 26 17:18:15.306804 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 364/668] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:14 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:15.564449 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c70c8fd6-79df-41c3-b9ea-384f48506588 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:15.565110 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c70c8fd6-79df-41c3-b9ea-384f48506588 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:15.572332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c70c8fd6-79df-41c3-b9ea-384f48506588 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:15.572849 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c70c8fd6-79df-41c3-b9ea-384f48506588 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:15.573761 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c70c8fd6-79df-41c3-b9ea-384f48506588 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:15.574210 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c70c8fd6-79df-41c3-b9ea-384f48506588 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:15.931413 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c70c8fd6-79df-41c3-b9ea-384f48506588 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:15.952207 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-da2a51ec-a677-4873-8389-43c2ba54e9aa req-cf197744-64cb-44d5-8785-e89f757e649f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7701e238-d4bd-4e91-9ae9-9a5845f8a1ce", "tag": "d2849b37-4de3-40c3-97ec-d1f87c72f88f"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:15.958727 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c70c8fd6-79df-41c3-b9ea-384f48506588 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.399017 Jul 26 17:18:15.969280 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 305/669] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:15 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:15.971998 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-da2a51ec-a677-4873-8389-43c2ba54e9aa req-cf197744-64cb-44d5-8785-e89f757e649f service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:15.972454 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-da2a51ec-a677-4873-8389-43c2ba54e9aa req-cf197744-64cb-44d5-8785-e89f757e649f service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:15.993723 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-da2a51ec-a677-4873-8389-43c2ba54e9aa req-cf197744-64cb-44d5-8785-e89f757e649f service nova] Creating event network-changed:d2849b37-4de3-40c3-97ec-d1f87c72f88f for instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce on hv-cinder-83538 Jul 26 17:18:16.000300 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-da2a51ec-a677-4873-8389-43c2ba54e9aa req-cf197744-64cb-44d5-8785-e89f757e649f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053133 Jul 26 17:18:16.000900 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 365/670] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:18:16.341661 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c4070a30-1d68-4f51-a8a5-1a8d61d0c1ef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:16.343119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c4070a30-1d68-4f51-a8a5-1a8d61d0c1ef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:16.356346 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c4070a30-1d68-4f51-a8a5-1a8d61d0c1ef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:16.357139 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c4070a30-1d68-4f51-a8a5-1a8d61d0c1ef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:16.358594 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c4070a30-1d68-4f51-a8a5-1a8d61d0c1ef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:16.359041 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c4070a30-1d68-4f51-a8a5-1a8d61d0c1ef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:16.536004 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c4070a30-1d68-4f51-a8a5-1a8d61d0c1ef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:16.547099 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c4070a30-1d68-4f51-a8a5-1a8d61d0c1ef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:16.549116 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c4070a30-1d68-4f51-a8a5-1a8d61d0c1ef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:16.550468 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c4070a30-1d68-4f51-a8a5-1a8d61d0c1ef tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.215585 Jul 26 17:18:16.563230 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 306/671] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:16 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:18:16.996207 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-29b9cc8a-eded-483e-ae2e-8f931471148a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:16.996899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-29b9cc8a-eded-483e-ae2e-8f931471148a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:17.004638 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29b9cc8a-eded-483e-ae2e-8f931471148a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:17.005170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29b9cc8a-eded-483e-ae2e-8f931471148a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:17.005971 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29b9cc8a-eded-483e-ae2e-8f931471148a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:17.006416 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29b9cc8a-eded-483e-ae2e-8f931471148a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:17.026461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:17.180209 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-29b9cc8a-eded-483e-ae2e-8f931471148a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:17.193019 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-29b9cc8a-eded-483e-ae2e-8f931471148a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.204335 Jul 26 17:18:17.193893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 366/672] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:16 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:17.580870 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ba320cb5-8175-4dde-9f53-3acebf4f7da3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:17.581536 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ba320cb5-8175-4dde-9f53-3acebf4f7da3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:17.584317 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:17.593693 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ba320cb5-8175-4dde-9f53-3acebf4f7da3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:17.594171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ba320cb5-8175-4dde-9f53-3acebf4f7da3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:17.594977 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ba320cb5-8175-4dde-9f53-3acebf4f7da3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:17.595416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ba320cb5-8175-4dde-9f53-3acebf4f7da3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:17.765074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ba320cb5-8175-4dde-9f53-3acebf4f7da3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:17.780081 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ba320cb5-8175-4dde-9f53-3acebf4f7da3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:17.781672 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ba320cb5-8175-4dde-9f53-3acebf4f7da3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:17.782865 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ba320cb5-8175-4dde-9f53-3acebf4f7da3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.206948 Jul 26 17:18:17.783434 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 307/673] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:17 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:18.021592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-30bd4f73-5d28-4769-9712-be3027c957da req-cd768cc3-a030-4f0f-860a-f4dfe8a3bd3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7701e238-d4bd-4e91-9ae9-9a5845f8a1ce", "tag": "d2849b37-4de3-40c3-97ec-d1f87c72f88f"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:18.039869 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-30bd4f73-5d28-4769-9712-be3027c957da req-cd768cc3-a030-4f0f-860a-f4dfe8a3bd3d service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:18.040676 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-30bd4f73-5d28-4769-9712-be3027c957da req-cd768cc3-a030-4f0f-860a-f4dfe8a3bd3d service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:18.059943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-30bd4f73-5d28-4769-9712-be3027c957da req-cd768cc3-a030-4f0f-860a-f4dfe8a3bd3d service nova] Creating event network-changed:d2849b37-4de3-40c3-97ec-d1f87c72f88f for instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce on hv-cinder-83538 Jul 26 17:18:18.065579 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-30bd4f73-5d28-4769-9712-be3027c957da req-cd768cc3-a030-4f0f-860a-f4dfe8a3bd3d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049729 Jul 26 17:18:18.066204 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 367/674] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:18:18.218897 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-655c9585-e924-4801-b880-8c4be6c12dec tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:18.219696 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-655c9585-e924-4801-b880-8c4be6c12dec tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:18.227032 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-655c9585-e924-4801-b880-8c4be6c12dec tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:18.227480 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-655c9585-e924-4801-b880-8c4be6c12dec tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:18.228347 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-655c9585-e924-4801-b880-8c4be6c12dec tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:18.228782 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-655c9585-e924-4801-b880-8c4be6c12dec tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:18.383151 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-655c9585-e924-4801-b880-8c4be6c12dec tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:18.391567 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-655c9585-e924-4801-b880-8c4be6c12dec tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.177272 Jul 26 17:18:18.392127 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 308/675] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:18 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:18.807197 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7fef001d-9b87-4492-825f-ebb25a052115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:18.808500 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7fef001d-9b87-4492-825f-ebb25a052115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:18.815264 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fef001d-9b87-4492-825f-ebb25a052115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:18.815715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fef001d-9b87-4492-825f-ebb25a052115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:18.816491 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fef001d-9b87-4492-825f-ebb25a052115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:18.816921 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fef001d-9b87-4492-825f-ebb25a052115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:18.986157 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7fef001d-9b87-4492-825f-ebb25a052115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:18.994367 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7fef001d-9b87-4492-825f-ebb25a052115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:18.996405 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7fef001d-9b87-4492-825f-ebb25a052115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:18.997092 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7fef001d-9b87-4492-825f-ebb25a052115 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.194145 Jul 26 17:18:18.997655 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 368/676] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:18 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:19.412998 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-116c4fb0-edf5-4af7-8bde-1db4d2617347 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:19.413606 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-116c4fb0-edf5-4af7-8bde-1db4d2617347 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:19.420185 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-116c4fb0-edf5-4af7-8bde-1db4d2617347 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:19.420624 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-116c4fb0-edf5-4af7-8bde-1db4d2617347 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:19.421423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-116c4fb0-edf5-4af7-8bde-1db4d2617347 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:19.421856 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-116c4fb0-edf5-4af7-8bde-1db4d2617347 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:19.591422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-116c4fb0-edf5-4af7-8bde-1db4d2617347 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:19.599399 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-116c4fb0-edf5-4af7-8bde-1db4d2617347 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.190145 Jul 26 17:18:19.599988 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 309/677] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:19 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:20.021348 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7f20421a-c5a1-4a6e-90ee-a4be2973af76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:20.021950 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7f20421a-c5a1-4a6e-90ee-a4be2973af76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:20.030012 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f20421a-c5a1-4a6e-90ee-a4be2973af76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:20.030468 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f20421a-c5a1-4a6e-90ee-a4be2973af76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:20.031261 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f20421a-c5a1-4a6e-90ee-a4be2973af76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:20.031708 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f20421a-c5a1-4a6e-90ee-a4be2973af76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:20.168581 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7f20421a-c5a1-4a6e-90ee-a4be2973af76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:20.176985 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7f20421a-c5a1-4a6e-90ee-a4be2973af76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:20.178496 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7f20421a-c5a1-4a6e-90ee-a4be2973af76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:20.179687 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7f20421a-c5a1-4a6e-90ee-a4be2973af76 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.162313 Jul 26 17:18:20.180257 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 369/678] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:20 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:20.620128 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-84c11cde-8067-4f24-9fd2-cdbdbfe9fd2f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:20.621314 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-84c11cde-8067-4f24-9fd2-cdbdbfe9fd2f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:20.629585 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84c11cde-8067-4f24-9fd2-cdbdbfe9fd2f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:20.630058 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84c11cde-8067-4f24-9fd2-cdbdbfe9fd2f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:20.630873 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84c11cde-8067-4f24-9fd2-cdbdbfe9fd2f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:20.631319 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84c11cde-8067-4f24-9fd2-cdbdbfe9fd2f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:20.790882 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-84c11cde-8067-4f24-9fd2-cdbdbfe9fd2f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:20.800089 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-84c11cde-8067-4f24-9fd2-cdbdbfe9fd2f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.183964 Jul 26 17:18:20.800997 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 310/679] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:20 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:21.205734 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-932eb81e-2559-4b95-bcb4-7e0271b77616 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:21.207292 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-932eb81e-2559-4b95-bcb4-7e0271b77616 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:21.217010 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-932eb81e-2559-4b95-bcb4-7e0271b77616 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:21.217938 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-932eb81e-2559-4b95-bcb4-7e0271b77616 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:21.218980 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-932eb81e-2559-4b95-bcb4-7e0271b77616 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:21.219978 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-932eb81e-2559-4b95-bcb4-7e0271b77616 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:21.528946 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-932eb81e-2559-4b95-bcb4-7e0271b77616 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:21.537823 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-932eb81e-2559-4b95-bcb4-7e0271b77616 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:21.539354 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-932eb81e-2559-4b95-bcb4-7e0271b77616 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:21.540535 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-932eb81e-2559-4b95-bcb4-7e0271b77616 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1725 microversion: 2.20 time: 0.339659 Jul 26 17:18:21.541132 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 370/680] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:21 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1725 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:18:21.827486 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1ae77f31-cd7f-4cb8-9a5a-8221910c9f29 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:21.828267 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1ae77f31-cd7f-4cb8-9a5a-8221910c9f29 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:21.840773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1ae77f31-cd7f-4cb8-9a5a-8221910c9f29 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:21.841666 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1ae77f31-cd7f-4cb8-9a5a-8221910c9f29 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:21.843067 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1ae77f31-cd7f-4cb8-9a5a-8221910c9f29 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:21.843887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1ae77f31-cd7f-4cb8-9a5a-8221910c9f29 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:22.021354 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1ae77f31-cd7f-4cb8-9a5a-8221910c9f29 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:22.023586 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:22.032048 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1ae77f31-cd7f-4cb8-9a5a-8221910c9f29 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.212234 Jul 26 17:18:22.032640 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 311/681] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:21 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:22.568754 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3fe54e71-3a91-426e-8197-00df43ca6f2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:22.570138 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3fe54e71-3a91-426e-8197-00df43ca6f2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:22.579714 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=82 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:22.583113 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fe54e71-3a91-426e-8197-00df43ca6f2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:22.584379 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fe54e71-3a91-426e-8197-00df43ca6f2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:22.585500 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fe54e71-3a91-426e-8197-00df43ca6f2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:22.586110 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fe54e71-3a91-426e-8197-00df43ca6f2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:22.753249 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3fe54e71-3a91-426e-8197-00df43ca6f2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:22.754615 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-d8243c46-fa9c-4fa2-ba7b-eae08c7c90f1 req-e6a666ac-42c4-442d-bd55-a49952be6c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7d66fd-65f0-4c03-8f1e-93d1ec23d411", "name": "network-vif-deleted", "tag": "5a304d69-32d1-40aa-b33c-fe4e3d47a965"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:22.767378 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3fe54e71-3a91-426e-8197-00df43ca6f2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:22.769610 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3fe54e71-3a91-426e-8197-00df43ca6f2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:22.771152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3fe54e71-3a91-426e-8197-00df43ca6f2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 200 len: 1657 microversion: 2.20 time: 0.206862 Jul 26 17:18:22.771921 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 371/682] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:22 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 1657 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:18:22.778231 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-d8243c46-fa9c-4fa2-ba7b-eae08c7c90f1 req-e6a666ac-42c4-442d-bd55-a49952be6c8b service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:22.778459 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-d8243c46-fa9c-4fa2-ba7b-eae08c7c90f1 req-e6a666ac-42c4-442d-bd55-a49952be6c8b service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:22.809308 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-d8243c46-fa9c-4fa2-ba7b-eae08c7c90f1 req-e6a666ac-42c4-442d-bd55-a49952be6c8b service nova] Creating event network-vif-deleted:5a304d69-32d1-40aa-b33c-fe4e3d47a965 for instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 on hv-cinder-83538 Jul 26 17:18:22.815756 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-d8243c46-fa9c-4fa2-ba7b-eae08c7c90f1 req-e6a666ac-42c4-442d-bd55-a49952be6c8b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068297 Jul 26 17:18:22.816395 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 312/683] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:18:23.060942 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dda74b81-ed96-4537-b685-405f71c8cd37 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:23.062238 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dda74b81-ed96-4537-b685-405f71c8cd37 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:23.069105 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dda74b81-ed96-4537-b685-405f71c8cd37 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:23.069780 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dda74b81-ed96-4537-b685-405f71c8cd37 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:23.070599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dda74b81-ed96-4537-b685-405f71c8cd37 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:23.071125 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dda74b81-ed96-4537-b685-405f71c8cd37 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:23.277498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dda74b81-ed96-4537-b685-405f71c8cd37 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:23.286192 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dda74b81-ed96-4537-b685-405f71c8cd37 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.229377 Jul 26 17:18:23.297117 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 372/684] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:23 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:23.801789 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-274c0c29-0705-45d9-bcd9-3f489139295f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:23.802521 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-274c0c29-0705-45d9-bcd9-3f489139295f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:23.809626 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-274c0c29-0705-45d9-bcd9-3f489139295f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:23.810077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-274c0c29-0705-45d9-bcd9-3f489139295f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:23.811030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-274c0c29-0705-45d9-bcd9-3f489139295f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:23.811466 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-274c0c29-0705-45d9-bcd9-3f489139295f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:23.827089 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-274c0c29-0705-45d9-bcd9-3f489139295f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] HTTP exception thrown: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-274c0c29-0705-45d9-bcd9-3f489139295f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Request method failure captured: Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 HTTP/1.1 Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CC2-B6KfHOyz1rJ8CLd865021N5df4V3yafWv9Gr75q85K0u3Ak1k4gBQk36daeiaPwPHndI4-jWWmwwTlrAbcyCAgH8Thc8qaTLC2D2mDK0Lm5xo_ODCAgakRJA39CjmC3HD61JSG1Rrp_aemhXOqn7LJ-JrMryYau68Cr-JHC5EY Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 250e4bed3c4c4c9c94a3143b2c6a7533 Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:18:23.828772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:18:23.830253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:18:23.830253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:18:23.830253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 250e4bed3c4c4c9c94a3143b2c6a7533 Jul 26 17:18:23.830253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:18:23.830253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeShelveTestJSON-157429425-project Jul 26 17:18:23.830253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:18:23.830253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:18:23.830253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: ab248df5c41d4495b9c9f46ef33c1631 Jul 26 17:18:23.830253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-157429425-project Jul 26 17:18:23.830253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:18:23.830253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:18:23.830253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '0c7d66fd-65f0-4c03-8f1e-93d1ec23d411'} Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:18:23.831259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:18:23.833199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:23.835093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-274c0c29-0705-45d9-bcd9-3f489139295f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Returning 404 to user: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:18:23.835093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-274c0c29-0705-45d9-bcd9-3f489139295f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 404 len: 111 microversion: 2.20 time: 0.033638 Jul 26 17:18:23.835093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 313/685] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:23 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 17:18:23.843091 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-737e5b20-6cd2-4ba6-963d-030fae5a17bf tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '.version_select at 0x7f6ca8942c10>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:23.872022 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-737e5b20-6cd2-4ba6-963d-030fae5a17bf tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1047868450" status: 204 len: 0 microversion: 2.20 time: 0.035810 Jul 26 17:18:23.872848 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 373/686] 10.222.0.48 () {60 vars in 1262 bytes} [Tue Jul 26 17:18:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1047868450 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 17:18:24.308890 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5c9713d5-7f9a-4fae-959b-b8ad857f3406 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:24.309307 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5c9713d5-7f9a-4fae-959b-b8ad857f3406 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:24.318131 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5c9713d5-7f9a-4fae-959b-b8ad857f3406 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:24.319169 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5c9713d5-7f9a-4fae-959b-b8ad857f3406 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:24.321176 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5c9713d5-7f9a-4fae-959b-b8ad857f3406 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:24.322132 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5c9713d5-7f9a-4fae-959b-b8ad857f3406 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:24.525746 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5c9713d5-7f9a-4fae-959b-b8ad857f3406 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:24.536101 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5c9713d5-7f9a-4fae-959b-b8ad857f3406 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.231871 Jul 26 17:18:24.536836 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 314/687] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:24 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:24.646964 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-0054042d-6c62-49e5-9207-5f579f681cd6 req-5ecd5734-2ace-4e02-a0f4-2dfe08572e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba8d6de-7d63-4f9a-be56-ff498118e97c", "name": "network-vif-plugged", "status": "completed", "tag": "2da04427-a247-4f2b-8fae-9dd8d6672da1"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:24.658828 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-0054042d-6c62-49e5-9207-5f579f681cd6 req-5ecd5734-2ace-4e02-a0f4-2dfe08572e8b service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:24.659271 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-0054042d-6c62-49e5-9207-5f579f681cd6 req-5ecd5734-2ace-4e02-a0f4-2dfe08572e8b service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:24.671770 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-0054042d-6c62-49e5-9207-5f579f681cd6 req-5ecd5734-2ace-4e02-a0f4-2dfe08572e8b service nova] Creating event network-vif-plugged:2da04427-a247-4f2b-8fae-9dd8d6672da1 for instance eba8d6de-7d63-4f9a-be56-ff498118e97c on hv-cinder-83538 Jul 26 17:18:24.677795 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-0054042d-6c62-49e5-9207-5f579f681cd6 req-5ecd5734-2ace-4e02-a0f4-2dfe08572e8b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034470 Jul 26 17:18:24.678872 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 374/688] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:18:24.925121 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c5a8b007-57c2-4b63-9f63-ac63f2ebafbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Action: 'create', calling method: .version_select at 0x7f6ca91d8040>, body: {"keypair": {"name": "tempest-keypair-2071824845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6Z+jw02c4DLVvlnt38OCMtcdPuIBICSb8RNNQJy172pHYrWC+Ou2wes7RVLpCgHWdNq6vV2nDDUduPJil/wUa89XHUINA10g+dm1snsWapYW+1Cb21f56t35DvhCrjsA=="}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:24.943220 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-c5a8b007-57c2-4b63-9f63-ac63f2ebafbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Getting quotas for project 250e4bed3c4c4c9c94a3143b2c6a7533. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:18:24.948120 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-c5a8b007-57c2-4b63-9f63-ac63f2ebafbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Getting quotas for user ab248df5c41d4495b9c9f46ef33c1631 and project 250e4bed3c4c4c9c94a3143b2c6a7533. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:18:24.974439 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c5a8b007-57c2-4b63-9f63-ac63f2ebafbb tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.057455 Jul 26 17:18:24.975217 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 315/689] 10.222.0.48 () {62 vars in 1200 bytes} [Tue Jul 26 17:18:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 17:18:25.558789 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c28ea9ac-7c59-4980-93c9-8515c8307889 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:25.560273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c28ea9ac-7c59-4980-93c9-8515c8307889 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:25.572752 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c28ea9ac-7c59-4980-93c9-8515c8307889 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:25.575299 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c28ea9ac-7c59-4980-93c9-8515c8307889 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:25.577044 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c28ea9ac-7c59-4980-93c9-8515c8307889 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:25.577922 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c28ea9ac-7c59-4980-93c9-8515c8307889 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:25.856684 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c28ea9ac-7c59-4980-93c9-8515c8307889 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:25.865978 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c28ea9ac-7c59-4980-93c9-8515c8307889 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1267 microversion: 2.1 time: 0.311361 Jul 26 17:18:25.866704 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 375/690] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:25 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1267 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:26.710882 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1748120240", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "245eeff0-7f98-4a51-8f09-c74191229e59"}], "security_groups": [{"name": "tempest-securitygroup--1170970452"}], "key_name": "tempest-keypair-2071824845", "user_data": "}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:26.837136 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.network.neutron [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] validate_networks() for [('245eeff0-7f98-4a51-8f09-c74191229e59', None, None, None, None, None)] {{(pid=118122) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:18:26.892463 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e904166a-eb01-4bdf-839e-d9b93f2edf8a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:26.893139 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e904166a-eb01-4bdf-839e-d9b93f2edf8a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:26.900746 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e904166a-eb01-4bdf-839e-d9b93f2edf8a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:26.901340 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e904166a-eb01-4bdf-839e-d9b93f2edf8a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:26.902772 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e904166a-eb01-4bdf-839e-d9b93f2edf8a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:26.903221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e904166a-eb01-4bdf-839e-d9b93f2edf8a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:27.068108 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e904166a-eb01-4bdf-839e-d9b93f2edf8a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:27.081335 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e904166a-eb01-4bdf-839e-d9b93f2edf8a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1454 microversion: 2.1 time: 0.192632 Jul 26 17:18:27.082021 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 376/691] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:26 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1454 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:27.106393 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dcf51239-5926-45c3-9b55-11b3bc058118 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:27.107010 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dcf51239-5926-45c3-9b55-11b3bc058118 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:27.115363 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcf51239-5926-45c3-9b55-11b3bc058118 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:27.115917 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcf51239-5926-45c3-9b55-11b3bc058118 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:27.117085 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcf51239-5926-45c3-9b55-11b3bc058118 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:27.117576 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcf51239-5926-45c3-9b55-11b3bc058118 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:27.320608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dcf51239-5926-45c3-9b55-11b3bc058118 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:27.330732 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dcf51239-5926-45c3-9b55-11b3bc058118 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1454 microversion: 2.1 time: 0.230726 Jul 26 17:18:27.331512 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 377/692] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:27 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1454 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:27.403889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Flavor limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:18:27.403889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Image limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:18:27.403889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Flavor pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:18:27.404410 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Image pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:18:27.405242 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:18:27.415636 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:27.416190 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:27.417747 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:27.418562 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:27.438079 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Getting quotas for project 250e4bed3c4c4c9c94a3143b2c6a7533. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:18:27.442888 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Getting quotas for user ab248df5c41d4495b9c9f46ef33c1631 and project 250e4bed3c4c4c9c94a3143b2c6a7533. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:18:27.456410 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Going to run 1 instances... {{(pid=118122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:18:27.458829 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:18:27.515910 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ae4785ac-89e0-4642-af1e-b6fde3f553df tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.882551 Jul 26 17:18:27.517172 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 316/693] 10.222.0.48 () {62 vars in 1188 bytes} [Tue Jul 26 17:18:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 17:18:27.532113 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-36efb841-3561-4b7c-a5dd-fdc39c97f7e9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:27.533240 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-36efb841-3561-4b7c-a5dd-fdc39c97f7e9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:27.612483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-36efb841-3561-4b7c-a5dd-fdc39c97f7e9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:27.623145 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-36efb841-3561-4b7c-a5dd-fdc39c97f7e9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:27.624073 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-36efb841-3561-4b7c-a5dd-fdc39c97f7e9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:27.626597 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-36efb841-3561-4b7c-a5dd-fdc39c97f7e9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1282 microversion: 2.20 time: 0.100575 Jul 26 17:18:27.626597 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 378/694] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:27 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:28.664302 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-fd2f7cfe-bd66-44bc-acd6-6e2d5bf67cc5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:28.664927 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-fd2f7cfe-bd66-44bc-acd6-6e2d5bf67cc5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:28.674593 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd2f7cfe-bd66-44bc-acd6-6e2d5bf67cc5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:28.674593 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd2f7cfe-bd66-44bc-acd6-6e2d5bf67cc5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:28.675380 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd2f7cfe-bd66-44bc-acd6-6e2d5bf67cc5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:28.675834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd2f7cfe-bd66-44bc-acd6-6e2d5bf67cc5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:28.747319 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-fd2f7cfe-bd66-44bc-acd6-6e2d5bf67cc5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:28.756416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-fd2f7cfe-bd66-44bc-acd6-6e2d5bf67cc5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:28.757978 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-fd2f7cfe-bd66-44bc-acd6-6e2d5bf67cc5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:28.759105 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-fd2f7cfe-bd66-44bc-acd6-6e2d5bf67cc5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1334 microversion: 2.20 time: 0.100290 Jul 26 17:18:28.759666 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 317/695] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:28 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:18:29.695682 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-73e61bf1-e00b-4e59-a255-47a86e925f76 req-edc353d8-a75f-4b0c-9254-ca0b2e8912a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba8d6de-7d63-4f9a-be56-ff498118e97c", "tag": "2da04427-a247-4f2b-8fae-9dd8d6672da1"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:29.715416 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-73e61bf1-e00b-4e59-a255-47a86e925f76 req-edc353d8-a75f-4b0c-9254-ca0b2e8912a9 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:29.716554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-73e61bf1-e00b-4e59-a255-47a86e925f76 req-edc353d8-a75f-4b0c-9254-ca0b2e8912a9 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:29.743641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-73e61bf1-e00b-4e59-a255-47a86e925f76 req-edc353d8-a75f-4b0c-9254-ca0b2e8912a9 service nova] Creating event network-changed:2da04427-a247-4f2b-8fae-9dd8d6672da1 for instance eba8d6de-7d63-4f9a-be56-ff498118e97c on hv-cinder-83538 Jul 26 17:18:29.754289 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-73e61bf1-e00b-4e59-a255-47a86e925f76 req-edc353d8-a75f-4b0c-9254-ca0b2e8912a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064590 Jul 26 17:18:29.755414 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 379/696] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:18:29.784621 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-088b9128-cff4-4ec6-ac20-c6245283f582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:29.785499 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-088b9128-cff4-4ec6-ac20-c6245283f582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:29.798844 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-088b9128-cff4-4ec6-ac20-c6245283f582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:29.799986 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-088b9128-cff4-4ec6-ac20-c6245283f582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:29.802564 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-088b9128-cff4-4ec6-ac20-c6245283f582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:29.803662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-088b9128-cff4-4ec6-ac20-c6245283f582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:29.928277 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-088b9128-cff4-4ec6-ac20-c6245283f582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:29.937725 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-088b9128-cff4-4ec6-ac20-c6245283f582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:29.939390 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-088b9128-cff4-4ec6-ac20-c6245283f582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:29.940749 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-088b9128-cff4-4ec6-ac20-c6245283f582 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1340 microversion: 2.20 time: 0.160233 Jul 26 17:18:29.941698 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 318/697] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:29 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1340 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:30.973013 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f4677462-04bc-498f-b05d-63bdd78445a6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:30.973907 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f4677462-04bc-498f-b05d-63bdd78445a6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:30.991423 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4677462-04bc-498f-b05d-63bdd78445a6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:30.993205 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4677462-04bc-498f-b05d-63bdd78445a6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:30.994941 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4677462-04bc-498f-b05d-63bdd78445a6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:30.997633 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4677462-04bc-498f-b05d-63bdd78445a6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:31.503156 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f4677462-04bc-498f-b05d-63bdd78445a6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:31.520002 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f4677462-04bc-498f-b05d-63bdd78445a6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:31.522386 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f4677462-04bc-498f-b05d-63bdd78445a6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:31.523728 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f4677462-04bc-498f-b05d-63bdd78445a6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1408 microversion: 2.20 time: 0.558618 Jul 26 17:18:31.538416 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 380/698] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:30 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1408 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:18:32.304122 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-a3c760a5-7b12-48a2-88ca-3f01855877a1 req-09ed0cef-5035-4861-b1ff-3f45a8a7b0ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a85ce7-0ab6-4543-a87c-8231bde9c4b5", "tag": "76e89343-401e-41b9-8e6d-0ed7a6b1167b"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:32.324423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-a3c760a5-7b12-48a2-88ca-3f01855877a1 req-09ed0cef-5035-4861-b1ff-3f45a8a7b0ce service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:32.324423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-a3c760a5-7b12-48a2-88ca-3f01855877a1 req-09ed0cef-5035-4861-b1ff-3f45a8a7b0ce service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:32.367971 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-a3c760a5-7b12-48a2-88ca-3f01855877a1 req-09ed0cef-5035-4861-b1ff-3f45a8a7b0ce service nova] Creating event network-changed:76e89343-401e-41b9-8e6d-0ed7a6b1167b for instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 on hv-cinder-83538 Jul 26 17:18:32.377382 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-a3c760a5-7b12-48a2-88ca-3f01855877a1 req-09ed0cef-5035-4861-b1ff-3f45a8a7b0ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076065 Jul 26 17:18:32.378506 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 319/699] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:18:32.548393 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-81f6ee4e-f94f-4834-b7a7-cbd1a1dde02d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:32.549239 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-81f6ee4e-f94f-4834-b7a7-cbd1a1dde02d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:32.566740 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81f6ee4e-f94f-4834-b7a7-cbd1a1dde02d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:32.567197 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81f6ee4e-f94f-4834-b7a7-cbd1a1dde02d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:32.569157 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81f6ee4e-f94f-4834-b7a7-cbd1a1dde02d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:32.570912 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81f6ee4e-f94f-4834-b7a7-cbd1a1dde02d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:32.850809 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-81f6ee4e-f94f-4834-b7a7-cbd1a1dde02d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:32.863778 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-81f6ee4e-f94f-4834-b7a7-cbd1a1dde02d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:32.865865 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-81f6ee4e-f94f-4834-b7a7-cbd1a1dde02d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:32.867888 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-81f6ee4e-f94f-4834-b7a7-cbd1a1dde02d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1408 microversion: 2.20 time: 0.323135 Jul 26 17:18:32.868912 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 381/700] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:32 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:33.893696 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1744ec7b-8da7-4642-a27f-4bb361c07e87 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:33.894400 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1744ec7b-8da7-4642-a27f-4bb361c07e87 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:33.901191 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1744ec7b-8da7-4642-a27f-4bb361c07e87 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:33.901792 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1744ec7b-8da7-4642-a27f-4bb361c07e87 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:33.903080 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1744ec7b-8da7-4642-a27f-4bb361c07e87 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:33.903525 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1744ec7b-8da7-4642-a27f-4bb361c07e87 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:34.054633 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1744ec7b-8da7-4642-a27f-4bb361c07e87 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:34.063844 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1744ec7b-8da7-4642-a27f-4bb361c07e87 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:34.065615 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1744ec7b-8da7-4642-a27f-4bb361c07e87 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:34.066765 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1744ec7b-8da7-4642-a27f-4bb361c07e87 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1408 microversion: 2.20 time: 0.177848 Jul 26 17:18:34.067333 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 320/701] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:33 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:34.335194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-05b7dc3b-f7f9-4e25-be5c-1898fb59f0fc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:34.337399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-05b7dc3b-f7f9-4e25-be5c-1898fb59f0fc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:34.345667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05b7dc3b-f7f9-4e25-be5c-1898fb59f0fc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:34.346116 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05b7dc3b-f7f9-4e25-be5c-1898fb59f0fc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:34.346903 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05b7dc3b-f7f9-4e25-be5c-1898fb59f0fc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:34.347332 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05b7dc3b-f7f9-4e25-be5c-1898fb59f0fc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:34.380736 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-05b7dc3b-f7f9-4e25-be5c-1898fb59f0fc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050565 Jul 26 17:18:34.381358 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 382/702] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:18:34 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 17:18:34.462338 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c6d27155-d78d-42f9-870b-96e7a52a6ac6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:34.463150 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c6d27155-d78d-42f9-870b-96e7a52a6ac6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:34.470662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c6d27155-d78d-42f9-870b-96e7a52a6ac6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:34.471231 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c6d27155-d78d-42f9-870b-96e7a52a6ac6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:34.472120 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c6d27155-d78d-42f9-870b-96e7a52a6ac6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:34.472632 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c6d27155-d78d-42f9-870b-96e7a52a6ac6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:34.511739 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c6d27155-d78d-42f9-870b-96e7a52a6ac6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Going to try to terminate instance {{(pid=118122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:18:34.614222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c6d27155-d78d-42f9-870b-96e7a52a6ac6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 204 len: 0 microversion: 2.1 time: 0.155847 Jul 26 17:18:34.615199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 321/703] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:18:34 2022] DELETE /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:18:34.625657 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dd597ce5-6203-4c5a-ad43-52cc1e45da58 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:34.626567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dd597ce5-6203-4c5a-ad43-52cc1e45da58 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:34.632906 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd597ce5-6203-4c5a-ad43-52cc1e45da58 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:34.633411 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd597ce5-6203-4c5a-ad43-52cc1e45da58 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:34.634256 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd597ce5-6203-4c5a-ad43-52cc1e45da58 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:34.634704 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd597ce5-6203-4c5a-ad43-52cc1e45da58 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:34.821593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dd597ce5-6203-4c5a-ad43-52cc1e45da58 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:34.829295 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dd597ce5-6203-4c5a-ad43-52cc1e45da58 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1673 microversion: 2.1 time: 0.209342 Jul 26 17:18:34.829876 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 383/704] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:34 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1673 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:35.091695 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5da66118-7010-4c56-97d2-8e2f2067b759 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:35.092388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5da66118-7010-4c56-97d2-8e2f2067b759 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:35.098462 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5da66118-7010-4c56-97d2-8e2f2067b759 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:35.098911 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5da66118-7010-4c56-97d2-8e2f2067b759 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:35.099681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5da66118-7010-4c56-97d2-8e2f2067b759 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:35.100117 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5da66118-7010-4c56-97d2-8e2f2067b759 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:35.235705 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5da66118-7010-4c56-97d2-8e2f2067b759 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:35.244109 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5da66118-7010-4c56-97d2-8e2f2067b759 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:35.245883 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5da66118-7010-4c56-97d2-8e2f2067b759 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:35.247247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5da66118-7010-4c56-97d2-8e2f2067b759 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1408 microversion: 2.20 time: 0.161578 Jul 26 17:18:35.247821 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 322/705] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:35 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:35.852311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4c2131d2-c65d-49db-a193-d2e0c7a166cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:35.852923 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4c2131d2-c65d-49db-a193-d2e0c7a166cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:35.860251 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c2131d2-c65d-49db-a193-d2e0c7a166cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:35.860697 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c2131d2-c65d-49db-a193-d2e0c7a166cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:35.861495 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c2131d2-c65d-49db-a193-d2e0c7a166cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:35.861923 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c2131d2-c65d-49db-a193-d2e0c7a166cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:36.003496 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4c2131d2-c65d-49db-a193-d2e0c7a166cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:36.011955 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4c2131d2-c65d-49db-a193-d2e0c7a166cd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1673 microversion: 2.1 time: 0.163312 Jul 26 17:18:36.012537 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 384/706] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:35 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:36.270734 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0334e920-6d91-45cb-ba0b-084ba239d00d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:36.271348 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0334e920-6d91-45cb-ba0b-084ba239d00d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:36.279332 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0334e920-6d91-45cb-ba0b-084ba239d00d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:36.279787 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0334e920-6d91-45cb-ba0b-084ba239d00d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:36.280570 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0334e920-6d91-45cb-ba0b-084ba239d00d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:36.281043 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0334e920-6d91-45cb-ba0b-084ba239d00d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:36.422820 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0334e920-6d91-45cb-ba0b-084ba239d00d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:36.431971 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0334e920-6d91-45cb-ba0b-084ba239d00d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:36.434027 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0334e920-6d91-45cb-ba0b-084ba239d00d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:36.435201 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0334e920-6d91-45cb-ba0b-084ba239d00d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1408 microversion: 2.20 time: 0.168277 Jul 26 17:18:36.435775 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 323/707] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:36 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:36.495004 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-02b180c4-6876-4010-84ef-3eded03f8278 req-9f8c4986-6706-4b23-86f9-ae1298d7099e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a85ce7-0ab6-4543-a87c-8231bde9c4b5", "name": "network-vif-plugged", "status": "completed", "tag": "76e89343-401e-41b9-8e6d-0ed7a6b1167b"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:36.506351 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-02b180c4-6876-4010-84ef-3eded03f8278 req-9f8c4986-6706-4b23-86f9-ae1298d7099e service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:36.507436 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-02b180c4-6876-4010-84ef-3eded03f8278 req-9f8c4986-6706-4b23-86f9-ae1298d7099e service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:36.520274 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-02b180c4-6876-4010-84ef-3eded03f8278 req-9f8c4986-6706-4b23-86f9-ae1298d7099e service nova] Creating event network-vif-plugged:76e89343-401e-41b9-8e6d-0ed7a6b1167b for instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 on hv-cinder-83538 Jul 26 17:18:36.525334 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-02b180c4-6876-4010-84ef-3eded03f8278 req-9f8c4986-6706-4b23-86f9-ae1298d7099e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033963 Jul 26 17:18:36.525936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 385/708] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:18:37.033685 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e1dfba21-6cc9-4a50-b635-b2952834a57d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:37.034295 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-e1dfba21-6cc9-4a50-b635-b2952834a57d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:37.040560 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e1dfba21-6cc9-4a50-b635-b2952834a57d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:37.041048 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e1dfba21-6cc9-4a50-b635-b2952834a57d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:37.041835 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e1dfba21-6cc9-4a50-b635-b2952834a57d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:37.042277 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e1dfba21-6cc9-4a50-b635-b2952834a57d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:37.179090 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e1dfba21-6cc9-4a50-b635-b2952834a57d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:37.187826 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e1dfba21-6cc9-4a50-b635-b2952834a57d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1673 microversion: 2.1 time: 0.157870 Jul 26 17:18:37.188424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 324/709] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:37 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:37.459417 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a3d36a20-0f62-4986-824d-ebd92a91591e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:37.460182 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a3d36a20-0f62-4986-824d-ebd92a91591e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:37.466838 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3d36a20-0f62-4986-824d-ebd92a91591e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:37.467294 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3d36a20-0f62-4986-824d-ebd92a91591e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:37.468080 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3d36a20-0f62-4986-824d-ebd92a91591e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:37.468527 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3d36a20-0f62-4986-824d-ebd92a91591e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:37.621979 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:37.727959 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a3d36a20-0f62-4986-824d-ebd92a91591e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:37.740270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a3d36a20-0f62-4986-824d-ebd92a91591e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:37.742048 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a3d36a20-0f62-4986-824d-ebd92a91591e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:37.743267 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a3d36a20-0f62-4986-824d-ebd92a91591e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1408 microversion: 2.20 time: 0.288725 Jul 26 17:18:37.743933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 386/710] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:37 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1408 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:38.223538 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a435eceb-b415-4b89-bdff-09603ae8b45f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:38.224427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a435eceb-b415-4b89-bdff-09603ae8b45f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:38.231520 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:38.233029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=10 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:38.235802 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a435eceb-b415-4b89-bdff-09603ae8b45f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:38.236427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a435eceb-b415-4b89-bdff-09603ae8b45f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:38.237493 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a435eceb-b415-4b89-bdff-09603ae8b45f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:38.238020 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a435eceb-b415-4b89-bdff-09603ae8b45f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:38.320101 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a435eceb-b415-4b89-bdff-09603ae8b45f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:38.331619 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a435eceb-b415-4b89-bdff-09603ae8b45f tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1605 microversion: 2.1 time: 0.111765 Jul 26 17:18:38.333257 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 325/711] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:38 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1605 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:38.406555 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-eba9328c-fc88-4614-85b5-fced64d214ed req-2b3e1b54-f5a4-4f25-951c-cdeb6a35e673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2799ba4-de59-4849-85e7-d0aaf12578e1", "name": "network-vif-deleted", "tag": "046c2444-d052-4814-b962-6109cd25ef6e"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:38.417700 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-eba9328c-fc88-4614-85b5-fced64d214ed req-2b3e1b54-f5a4-4f25-951c-cdeb6a35e673 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:38.418424 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-eba9328c-fc88-4614-85b5-fced64d214ed req-2b3e1b54-f5a4-4f25-951c-cdeb6a35e673 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:38.430782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-eba9328c-fc88-4614-85b5-fced64d214ed req-2b3e1b54-f5a4-4f25-951c-cdeb6a35e673 service nova] Creating event network-vif-deleted:046c2444-d052-4814-b962-6109cd25ef6e for instance e2799ba4-de59-4849-85e7-d0aaf12578e1 on hv-cinder-83538 Jul 26 17:18:38.437429 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-eba9328c-fc88-4614-85b5-fced64d214ed req-2b3e1b54-f5a4-4f25-951c-cdeb6a35e673 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035903 Jul 26 17:18:38.438410 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 387/712] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:18:38.767410 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a7b59e30-5c1e-4d32-86ef-7fa152bd5b2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:38.767953 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a7b59e30-5c1e-4d32-86ef-7fa152bd5b2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:38.774558 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7b59e30-5c1e-4d32-86ef-7fa152bd5b2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:38.775012 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7b59e30-5c1e-4d32-86ef-7fa152bd5b2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:38.775815 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7b59e30-5c1e-4d32-86ef-7fa152bd5b2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:38.776262 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7b59e30-5c1e-4d32-86ef-7fa152bd5b2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:38.935199 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a7b59e30-5c1e-4d32-86ef-7fa152bd5b2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:38.943467 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a7b59e30-5c1e-4d32-86ef-7fa152bd5b2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:38.945044 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a7b59e30-5c1e-4d32-86ef-7fa152bd5b2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:38.946973 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a7b59e30-5c1e-4d32-86ef-7fa152bd5b2e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1408 microversion: 2.20 time: 0.183474 Jul 26 17:18:38.951358 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 326/713] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:38 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:18:39.363672 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8f0f70ec-86b7-4e35-a51f-4837582c50ae tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:39.364365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8f0f70ec-86b7-4e35-a51f-4837582c50ae tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:39.372066 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f0f70ec-86b7-4e35-a51f-4837582c50ae tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:39.372810 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f0f70ec-86b7-4e35-a51f-4837582c50ae tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:39.373791 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f0f70ec-86b7-4e35-a51f-4837582c50ae tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:39.374401 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f0f70ec-86b7-4e35-a51f-4837582c50ae tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:39.393567 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:39.460542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8f0f70ec-86b7-4e35-a51f-4837582c50ae tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:39.471292 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8f0f70ec-86b7-4e35-a51f-4837582c50ae tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1322 microversion: 2.1 time: 0.112277 Jul 26 17:18:39.472346 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 388/714] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:39 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1322 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:39.971204 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c8be88f1-1385-40e4-a51f-67ab13b57f80 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:39.972030 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c8be88f1-1385-40e4-a51f-67ab13b57f80 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:39.978438 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c8be88f1-1385-40e4-a51f-67ab13b57f80 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:39.978889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c8be88f1-1385-40e4-a51f-67ab13b57f80 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:39.980451 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c8be88f1-1385-40e4-a51f-67ab13b57f80 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:39.980893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c8be88f1-1385-40e4-a51f-67ab13b57f80 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:40.131365 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c8be88f1-1385-40e4-a51f-67ab13b57f80 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:40.144041 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c8be88f1-1385-40e4-a51f-67ab13b57f80 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:40.147102 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c8be88f1-1385-40e4-a51f-67ab13b57f80 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:40.148437 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c8be88f1-1385-40e4-a51f-67ab13b57f80 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1408 microversion: 2.20 time: 0.181155 Jul 26 17:18:40.166042 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 327/715] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:39 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:40.494487 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-01dd592b-8f94-4fc5-9667-8d0a1d29cda2 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:40.495087 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-01dd592b-8f94-4fc5-9667-8d0a1d29cda2 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:40.502083 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01dd592b-8f94-4fc5-9667-8d0a1d29cda2 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:40.502452 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01dd592b-8f94-4fc5-9667-8d0a1d29cda2 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:40.503227 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01dd592b-8f94-4fc5-9667-8d0a1d29cda2 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:40.503660 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01dd592b-8f94-4fc5-9667-8d0a1d29cda2 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:40.536532 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01dd592b-8f94-4fc5-9667-8d0a1d29cda2 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:40.537005 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01dd592b-8f94-4fc5-9667-8d0a1d29cda2 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:40.537461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-01dd592b-8f94-4fc5-9667-8d0a1d29cda2 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lazy-loading 'fault' on Instance uuid e2799ba4-de59-4849-85e7-d0aaf12578e1 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:18:40.583657 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-01dd592b-8f94-4fc5-9667-8d0a1d29cda2 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:40.592326 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-01dd592b-8f94-4fc5-9667-8d0a1d29cda2 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1327 microversion: 2.1 time: 0.101759 Jul 26 17:18:40.593120 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 389/716] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:40 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:41.176835 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e262ddbc-9599-4532-b9e6-8adf615c3229 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:41.177491 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-e262ddbc-9599-4532-b9e6-8adf615c3229 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:41.185723 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e262ddbc-9599-4532-b9e6-8adf615c3229 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:41.185972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e262ddbc-9599-4532-b9e6-8adf615c3229 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:41.186772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e262ddbc-9599-4532-b9e6-8adf615c3229 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:41.187216 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e262ddbc-9599-4532-b9e6-8adf615c3229 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:41.334929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e262ddbc-9599-4532-b9e6-8adf615c3229 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:41.344024 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e262ddbc-9599-4532-b9e6-8adf615c3229 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:41.345553 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e262ddbc-9599-4532-b9e6-8adf615c3229 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:41.346716 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e262ddbc-9599-4532-b9e6-8adf615c3229 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1601 microversion: 2.20 time: 0.174161 Jul 26 17:18:41.347289 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 328/717] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:18:41 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:18:41.373197 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-78d92326-c186-4626-8363-634c0a3521dd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:41.373687 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-78d92326-c186-4626-8363-634c0a3521dd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:41.380190 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78d92326-c186-4626-8363-634c0a3521dd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:41.380724 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78d92326-c186-4626-8363-634c0a3521dd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:41.381557 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78d92326-c186-4626-8363-634c0a3521dd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:41.381993 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78d92326-c186-4626-8363-634c0a3521dd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:41.468356 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-78d92326-c186-4626-8363-634c0a3521dd tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.099617 Jul 26 17:18:41.469000 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 390/718] 10.222.0.48 () {60 vars in 1316 bytes} [Tue Jul 26 17:18:41 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:18:41.614461 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-356b089c-5eb3-4d08-9648-d1c313964684 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:41.614959 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-356b089c-5eb3-4d08-9648-d1c313964684 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:41.621675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-356b089c-5eb3-4d08-9648-d1c313964684 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:41.622230 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-356b089c-5eb3-4d08-9648-d1c313964684 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:41.623004 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-356b089c-5eb3-4d08-9648-d1c313964684 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:41.623632 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-356b089c-5eb3-4d08-9648-d1c313964684 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:41.658857 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-356b089c-5eb3-4d08-9648-d1c313964684 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:41.659730 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-356b089c-5eb3-4d08-9648-d1c313964684 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:41.660386 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.objects.instance [None req-356b089c-5eb3-4d08-9648-d1c313964684 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lazy-loading 'fault' on Instance uuid e2799ba4-de59-4849-85e7-d0aaf12578e1 {{(pid=118122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:18:41.736862 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-356b089c-5eb3-4d08-9648-d1c313964684 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:41.744026 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-356b089c-5eb3-4d08-9648-d1c313964684 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 200 len: 1327 microversion: 2.1 time: 0.133459 Jul 26 17:18:41.744628 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 329/719] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:41 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:42.730385 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-905f1269-0d05-425f-9835-8c406d947563 req-8686eea4-8729-49d6-a14a-4ba00e7c516e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a85ce7-0ab6-4543-a87c-8231bde9c4b5", "tag": "76e89343-401e-41b9-8e6d-0ed7a6b1167b"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:42.741344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-905f1269-0d05-425f-9835-8c406d947563 req-8686eea4-8729-49d6-a14a-4ba00e7c516e service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:42.741792 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-905f1269-0d05-425f-9835-8c406d947563 req-8686eea4-8729-49d6-a14a-4ba00e7c516e service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:42.754899 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-905f1269-0d05-425f-9835-8c406d947563 req-8686eea4-8729-49d6-a14a-4ba00e7c516e service nova] Creating event network-changed:76e89343-401e-41b9-8e6d-0ed7a6b1167b for instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 on hv-cinder-83538 Jul 26 17:18:42.760014 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-905f1269-0d05-425f-9835-8c406d947563 req-8686eea4-8729-49d6-a14a-4ba00e7c516e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199643 Jul 26 17:18:42.760539 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 391/720] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:18:42.767770 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1c0382a4-7b3b-4f56-832b-e3d7ca2a336e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:42.768432 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1c0382a4-7b3b-4f56-832b-e3d7ca2a336e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:42.777591 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c0382a4-7b3b-4f56-832b-e3d7ca2a336e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:42.778150 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c0382a4-7b3b-4f56-832b-e3d7ca2a336e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:42.779032 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c0382a4-7b3b-4f56-832b-e3d7ca2a336e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:42.779565 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c0382a4-7b3b-4f56-832b-e3d7ca2a336e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:42.783978 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:42.795800 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-1c0382a4-7b3b-4f56-832b-e3d7ca2a336e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] HTTP exception thrown: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1c0382a4-7b3b-4f56-832b-e3d7ca2a336e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Request method failure captured: Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 HTTP/1.1 Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CC8XEx5Rtb0mXla7Ve2uAgbG9ZkDE9Lrp3gFHxtMJ-cnR5xJniJHbZKg3CkKepAd7xwyKfWKelAvBA9Oo2enkNrApvDbmbwv2i1jX4zlCB6g3tkP7TOvjMQJ6S_ryqrSvj0F15P14xR1ivj7qVjBzfBlPp8C5CoBlR-ipNg4QbSL4c Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 6f7fbc938d614078b719aa483aa80cd6 Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:18:42.797688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:18:42.805773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:18:42.805773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:18:42.805773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 6f7fbc938d614078b719aa483aa80cd6 Jul 26 17:18:42.805773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:18:42.805773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeTestJSON-329568771-project Jul 26 17:18:42.805773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:18:42.805773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:18:42.805773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: 459db7ff580948dc853b9f843700fe3c Jul 26 17:18:42.805773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeTestJSON-329568771-project Jul 26 17:18:42.805773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:18:42.805773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:18:42.805773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': 'e2799ba4-de59-4849-85e7-d0aaf12578e1'} Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:18:42.807416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:18:42.810648 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:18:42.812942 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1c0382a4-7b3b-4f56-832b-e3d7ca2a336e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Returning 404 to user: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:18:42.812942 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1c0382a4-7b3b-4f56-832b-e3d7ca2a336e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 404 len: 111 microversion: 2.1 time: 0.035206 Jul 26 17:18:42.812942 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 330/721] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:42 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 17:18:42.813380 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d4dd0773-fa6d-45d2-9675-6e875a16f872 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '.version_select at 0x7f6ca8938790>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:42.833269 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d4dd0773-fa6d-45d2-9675-6e875a16f872 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-390488908" status: 202 len: 0 microversion: 2.1 time: 0.026739 Jul 26 17:18:42.834085 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 392/722] 10.222.0.48 () {58 vars in 1218 bytes} [Tue Jul 26 17:18:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-390488908 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:18:43.837069 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-87aaa6eb-909e-4331-8811-a53539793349 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Action: 'create', calling method: .version_select at 0x7f6ca919f820>, body: {"keypair": {"name": "tempest-keypair-632008487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfaGlwehWs8EKjP8UXWR6/IQ1phWzJyvni77thFD50wCMyKOZjCUUU5gaOlskN9xcjh8OC5kYuSTRCtyKEnFi+B7hRMTh4qhZbRMkU+e2ti/5Vc9/ilqvdj07tN4GyVYA=="}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:43.856438 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-87aaa6eb-909e-4331-8811-a53539793349 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Getting quotas for project 6f7fbc938d614078b719aa483aa80cd6. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:18:43.861630 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-87aaa6eb-909e-4331-8811-a53539793349 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Getting quotas for user 459db7ff580948dc853b9f843700fe3c and project 6f7fbc938d614078b719aa483aa80cd6. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:18:43.890844 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-87aaa6eb-909e-4331-8811-a53539793349 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057504 Jul 26 17:18:43.892301 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 331/723] 10.222.0.48 () {60 vars in 1159 bytes} [Tue Jul 26 17:18:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:18:45.277009 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1835226505", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13ed1e51-7981-4e97-88de-552dbce88f21"}], "security_groups": [{"name": "tempest-securitygroup--1143133753"}], "key_name": "tempest-keypair-632008487", "user_data": "}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:45.396156 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] validate_networks() for [('13ed1e51-7981-4e97-88de-552dbce88f21', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:18:46.208586 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:18:46.209126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:18:46.209598 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:18:46.210005 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:18:46.210413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:18:46.220400 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:46.220844 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:46.221671 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:46.222099 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:46.240130 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Getting quotas for project 6f7fbc938d614078b719aa483aa80cd6. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:18:46.244368 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Getting quotas for user 459db7ff580948dc853b9f843700fe3c and project 6f7fbc938d614078b719aa483aa80cd6. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:18:46.258106 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:18:46.260298 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:18:46.309664 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-022e121e-04ac-4fa7-8ed6-f8b1bed23559 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.037421 Jul 26 17:18:46.315418 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 393/724] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:18:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:18:46.322075 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-94625914-dd8d-44ce-a5fc-80ef4c775162 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:46.322702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-94625914-dd8d-44ce-a5fc-80ef4c775162 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:46.393198 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-94625914-dd8d-44ce-a5fc-80ef4c775162 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:46.400752 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-94625914-dd8d-44ce-a5fc-80ef4c775162 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1237 microversion: 2.1 time: 0.083082 Jul 26 17:18:46.401973 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 332/725] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:46 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:47.423387 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7a0e1ac6-4015-4a06-b26d-ffd4bef06c53 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:47.424409 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7a0e1ac6-4015-4a06-b26d-ffd4bef06c53 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:47.435036 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a0e1ac6-4015-4a06-b26d-ffd4bef06c53 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:47.435553 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a0e1ac6-4015-4a06-b26d-ffd4bef06c53 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:47.436421 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a0e1ac6-4015-4a06-b26d-ffd4bef06c53 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:47.437062 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a0e1ac6-4015-4a06-b26d-ffd4bef06c53 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:47.581142 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7a0e1ac6-4015-4a06-b26d-ffd4bef06c53 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:47.589314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7a0e1ac6-4015-4a06-b26d-ffd4bef06c53 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1297 microversion: 2.1 time: 0.169933 Jul 26 17:18:47.590003 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 394/726] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:47 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1297 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:48.611631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7dea6333-e13f-4c36-b370-b3e84a8ecda8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:48.612245 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7dea6333-e13f-4c36-b370-b3e84a8ecda8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:48.615911 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:48.621743 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7dea6333-e13f-4c36-b370-b3e84a8ecda8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:48.622401 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7dea6333-e13f-4c36-b370-b3e84a8ecda8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:48.623431 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7dea6333-e13f-4c36-b370-b3e84a8ecda8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:48.623937 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7dea6333-e13f-4c36-b370-b3e84a8ecda8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:49.066495 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7dea6333-e13f-4c36-b370-b3e84a8ecda8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:49.076248 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7dea6333-e13f-4c36-b370-b3e84a8ecda8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1363 microversion: 2.1 time: 0.468252 Jul 26 17:18:49.077672 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 333/727] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:48 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1363 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:49.395187 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-f012b47f-64a9-4eb9-a79e-dcb9376f4a4c req-cfc542b5-2abc-4591-90d8-b91f4acc8f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bd0d4f3-4697-482a-a601-7bb08472adfc", "tag": "690c7a63-c7a8-4fc8-8076-272d7bf01fee"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:49.414190 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-f012b47f-64a9-4eb9-a79e-dcb9376f4a4c req-cfc542b5-2abc-4591-90d8-b91f4acc8f05 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:49.414976 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-f012b47f-64a9-4eb9-a79e-dcb9376f4a4c req-cfc542b5-2abc-4591-90d8-b91f4acc8f05 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:49.437445 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-f012b47f-64a9-4eb9-a79e-dcb9376f4a4c req-cfc542b5-2abc-4591-90d8-b91f4acc8f05 service nova] Creating event network-changed:690c7a63-c7a8-4fc8-8076-272d7bf01fee for instance 0bd0d4f3-4697-482a-a601-7bb08472adfc on hv-cinder-83538 Jul 26 17:18:49.446336 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-f012b47f-64a9-4eb9-a79e-dcb9376f4a4c req-cfc542b5-2abc-4591-90d8-b91f4acc8f05 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161727 Jul 26 17:18:49.447604 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 395/728] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:18:50.112853 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-07fc2dc6-27ce-475f-aaa4-64f50715b3f1 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:50.113528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-07fc2dc6-27ce-475f-aaa4-64f50715b3f1 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:50.120726 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-07fc2dc6-27ce-475f-aaa4-64f50715b3f1 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:50.121357 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-07fc2dc6-27ce-475f-aaa4-64f50715b3f1 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:50.122171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-07fc2dc6-27ce-475f-aaa4-64f50715b3f1 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:50.122639 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-07fc2dc6-27ce-475f-aaa4-64f50715b3f1 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:50.271049 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-07fc2dc6-27ce-475f-aaa4-64f50715b3f1 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:50.280587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-07fc2dc6-27ce-475f-aaa4-64f50715b3f1 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1363 microversion: 2.1 time: 0.172843 Jul 26 17:18:50.281201 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 334/729] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:50 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:51.302958 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-87e76f12-7753-428b-b27d-e65f4f50d518 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:51.303718 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-87e76f12-7753-428b-b27d-e65f4f50d518 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:51.311480 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87e76f12-7753-428b-b27d-e65f4f50d518 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:51.311955 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87e76f12-7753-428b-b27d-e65f4f50d518 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:51.312718 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87e76f12-7753-428b-b27d-e65f4f50d518 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:51.313182 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87e76f12-7753-428b-b27d-e65f4f50d518 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:51.550758 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-87e76f12-7753-428b-b27d-e65f4f50d518 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:51.558675 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-87e76f12-7753-428b-b27d-e65f4f50d518 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1363 microversion: 2.1 time: 0.259917 Jul 26 17:18:51.559270 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 396/730] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:51 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:52.580210 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2ced7c52-3abc-4db3-952d-bc29dd245702 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:52.580823 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2ced7c52-3abc-4db3-952d-bc29dd245702 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:52.587504 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2ced7c52-3abc-4db3-952d-bc29dd245702 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:52.587952 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2ced7c52-3abc-4db3-952d-bc29dd245702 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:52.589337 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2ced7c52-3abc-4db3-952d-bc29dd245702 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:52.589786 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2ced7c52-3abc-4db3-952d-bc29dd245702 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:52.736241 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-2ced7c52-3abc-4db3-952d-bc29dd245702 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:52.744309 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2ced7c52-3abc-4db3-952d-bc29dd245702 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1363 microversion: 2.1 time: 0.167826 Jul 26 17:18:52.745508 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 335/731] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:52 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:53.075475 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-93e93a45-8893-4bdb-9408-46cdf80f1d87 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:53.076060 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-93e93a45-8893-4bdb-9408-46cdf80f1d87 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:53.078184 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:53.083792 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93e93a45-8893-4bdb-9408-46cdf80f1d87 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:53.084248 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93e93a45-8893-4bdb-9408-46cdf80f1d87 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:53.085278 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93e93a45-8893-4bdb-9408-46cdf80f1d87 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:53.085933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93e93a45-8893-4bdb-9408-46cdf80f1d87 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:53.114934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-93e93a45-8893-4bdb-9408-46cdf80f1d87 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/ips" status: 200 len: 149 microversion: 2.1 time: 0.172069 Jul 26 17:18:53.115499 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 397/732] 10.222.0.48 () {58 vars in 1248 bytes} [Tue Jul 26 17:18:52 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/ips => generated 149 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:18:53.775965 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3f2a2a1b-66df-46d6-9e0c-dc25456d3038 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:53.776685 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3f2a2a1b-66df-46d6-9e0c-dc25456d3038 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:53.784053 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3f2a2a1b-66df-46d6-9e0c-dc25456d3038 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:53.784507 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3f2a2a1b-66df-46d6-9e0c-dc25456d3038 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:53.785356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3f2a2a1b-66df-46d6-9e0c-dc25456d3038 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:53.785789 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3f2a2a1b-66df-46d6-9e0c-dc25456d3038 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:53.983072 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3f2a2a1b-66df-46d6-9e0c-dc25456d3038 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:53.994597 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3f2a2a1b-66df-46d6-9e0c-dc25456d3038 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1363 microversion: 2.1 time: 0.222314 Jul 26 17:18:54.009246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 336/733] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:53 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:54.529456 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-438db652-5124-40b9-8fd9-963bdcf316fd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f5af591-2d7f-470f-8ec4-c037b68d077d"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:54.532013 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-438db652-5124-40b9-8fd9-963bdcf316fd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:54.540010 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-438db652-5124-40b9-8fd9-963bdcf316fd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:54.540550 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-438db652-5124-40b9-8fd9-963bdcf316fd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:54.541429 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-438db652-5124-40b9-8fd9-963bdcf316fd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:54.542568 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-438db652-5124-40b9-8fd9-963bdcf316fd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:54.854144 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-438db652-5124-40b9-8fd9-963bdcf316fd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329842 Jul 26 17:18:54.856219 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 398/734] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:18:54 2022] POST /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:18:55.022910 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-795edc2f-a6ee-4567-860c-59a369a92502 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:55.023517 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-795edc2f-a6ee-4567-860c-59a369a92502 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:55.032174 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-795edc2f-a6ee-4567-860c-59a369a92502 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:55.032618 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-795edc2f-a6ee-4567-860c-59a369a92502 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:55.033444 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-795edc2f-a6ee-4567-860c-59a369a92502 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:55.033886 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-795edc2f-a6ee-4567-860c-59a369a92502 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:55.196470 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-795edc2f-a6ee-4567-860c-59a369a92502 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:55.210269 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-795edc2f-a6ee-4567-860c-59a369a92502 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1363 microversion: 2.1 time: 0.191148 Jul 26 17:18:55.211372 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 337/735] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:55 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:55.427112 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-5a97adfc-df1b-4123-b3af-10958a509235 req-dea2d22e-4ac4-4633-a9a8-d5712d73a474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd0d4f3-4697-482a-a601-7bb08472adfc", "name": "network-vif-plugged", "status": "completed", "tag": "690c7a63-c7a8-4fc8-8076-272d7bf01fee"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:55.441956 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-5a97adfc-df1b-4123-b3af-10958a509235 req-dea2d22e-4ac4-4633-a9a8-d5712d73a474 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:55.442410 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-5a97adfc-df1b-4123-b3af-10958a509235 req-dea2d22e-4ac4-4633-a9a8-d5712d73a474 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:55.455827 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-5a97adfc-df1b-4123-b3af-10958a509235 req-dea2d22e-4ac4-4633-a9a8-d5712d73a474 service nova] Creating event network-vif-plugged:690c7a63-c7a8-4fc8-8076-272d7bf01fee for instance 0bd0d4f3-4697-482a-a601-7bb08472adfc on hv-cinder-83538 Jul 26 17:18:55.461146 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-5a97adfc-df1b-4123-b3af-10958a509235 req-dea2d22e-4ac4-4633-a9a8-d5712d73a474 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115182 Jul 26 17:18:55.461769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 399/736] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:18:56.233553 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6e9d3cd9-266f-4a85-88d6-b5d0c9db8563 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:56.234121 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6e9d3cd9-266f-4a85-88d6-b5d0c9db8563 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:56.242593 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6e9d3cd9-266f-4a85-88d6-b5d0c9db8563 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:56.243395 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6e9d3cd9-266f-4a85-88d6-b5d0c9db8563 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:56.244748 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6e9d3cd9-266f-4a85-88d6-b5d0c9db8563 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:56.245825 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6e9d3cd9-266f-4a85-88d6-b5d0c9db8563 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:56.397694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=6 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:56.420821 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6e9d3cd9-266f-4a85-88d6-b5d0c9db8563 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:56.436796 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6e9d3cd9-266f-4a85-88d6-b5d0c9db8563 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1363 microversion: 2.1 time: 0.207701 Jul 26 17:18:56.437894 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 338/737] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:56 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:18:57.458544 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:57.460026 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=6 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:18:57.465817 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-32aa0d3b-9a3b-4f6f-8303-1821f0c068f7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:57.466810 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-32aa0d3b-9a3b-4f6f-8303-1821f0c068f7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:57.475399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32aa0d3b-9a3b-4f6f-8303-1821f0c068f7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:57.475856 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32aa0d3b-9a3b-4f6f-8303-1821f0c068f7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:57.476681 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32aa0d3b-9a3b-4f6f-8303-1821f0c068f7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:57.477161 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32aa0d3b-9a3b-4f6f-8303-1821f0c068f7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:57.641236 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-32aa0d3b-9a3b-4f6f-8303-1821f0c068f7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:18:57.652550 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-32aa0d3b-9a3b-4f6f-8303-1821f0c068f7 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1548 microversion: 2.1 time: 0.195759 Jul 26 17:18:57.653182 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 400/738] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:18:57 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:18:57.679742 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-05632648-d962-4bde-8bb5-b16d3fd62bef tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:18:57.680289 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-05632648-d962-4bde-8bb5-b16d3fd62bef tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:18:57.687651 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-05632648-d962-4bde-8bb5-b16d3fd62bef tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:57.688096 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-05632648-d962-4bde-8bb5-b16d3fd62bef tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:57.688869 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-05632648-d962-4bde-8bb5-b16d3fd62bef tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:57.689327 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-05632648-d962-4bde-8bb5-b16d3fd62bef tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:57.781525 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-05632648-d962-4bde-8bb5-b16d3fd62bef tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105738 Jul 26 17:18:57.782175 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 339/739] 10.222.0.48 () {58 vars in 1275 bytes} [Tue Jul 26 17:18:57 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:18:58.852876 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-d01d46c7-c98d-4a04-9aae-075503081f54 req-feee0338-0350-48eb-a5eb-e18a0cd65ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bd0d4f3-4697-482a-a601-7bb08472adfc", "tag": "690c7a63-c7a8-4fc8-8076-272d7bf01fee"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:18:58.863400 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-d01d46c7-c98d-4a04-9aae-075503081f54 req-feee0338-0350-48eb-a5eb-e18a0cd65ba0 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:18:58.863840 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-d01d46c7-c98d-4a04-9aae-075503081f54 req-feee0338-0350-48eb-a5eb-e18a0cd65ba0 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:18:58.876306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-d01d46c7-c98d-4a04-9aae-075503081f54 req-feee0338-0350-48eb-a5eb-e18a0cd65ba0 service nova] Creating event network-changed:690c7a63-c7a8-4fc8-8076-272d7bf01fee for instance 0bd0d4f3-4697-482a-a601-7bb08472adfc on hv-cinder-83538 Jul 26 17:18:58.881700 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-d01d46c7-c98d-4a04-9aae-075503081f54 req-feee0338-0350-48eb-a5eb-e18a0cd65ba0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032331 Jul 26 17:18:58.882397 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 401/740] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:02.494142 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-faf5b911-7f43-445c-97a4-48ca4a0d5716 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f5af591-2d7f-470f-8ec4-c037b68d077d"}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:02.496592 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-faf5b911-7f43-445c-97a4-48ca4a0d5716 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:02.503523 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-faf5b911-7f43-445c-97a4-48ca4a0d5716 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:02.503971 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-faf5b911-7f43-445c-97a4-48ca4a0d5716 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:02.504756 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-faf5b911-7f43-445c-97a4-48ca4a0d5716 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:02.505229 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-faf5b911-7f43-445c-97a4-48ca4a0d5716 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:02.599815 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-faf5b911-7f43-445c-97a4-48ca4a0d5716 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Invalid volume: volume 6f5af591-2d7f-470f-8ec4-c037b68d077d is already attached to instances: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-faf5b911-7f43-445c-97a4-48ca4a0d5716 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: POST /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments HTTP/1.1 Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 74 Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:19:02.601625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:19:02.603221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:19:02.603221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:19:02.603221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:19:02.603221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:19:02.603221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:19:02.603221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:19:02.603221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:19:02.603221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:19:02.603221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:19:02.603221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Jul 26 17:19:02.603221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {"volumeAttachment": {"volumeId": "6f5af591-2d7f-470f-8ec4-c037b68d077d"}} Jul 26 17:19:02.603221 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Invalid volume: volume 6f5af591-2d7f-470f-8ec4-c037b68d077d is already attached to instances: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'server_id': '8c1e9557-fc15-4ea5-9b93-de135b76dfeb', 'body': {'volumeAttachment': {'volumeId': '6f5af591-2d7f-470f-8ec4-c037b68d077d'}}} Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6f5af591-2d7f-470f-8ec4-c037b68d077d is already attached to instances: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:02.604074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6f5af591-2d7f-470f-8ec4-c037b68d077d is already attached to instances: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:02.606404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:19:02.607915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:19:02.607915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:19:02.607915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:19:02.607915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6f5af591-2d7f-470f-8ec4-c037b68d077d is already attached to instances: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb Jul 26 17:19:02.607915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:02.607915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-faf5b911-7f43-445c-97a4-48ca4a0d5716 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 400 to user: Invalid volume: volume 6f5af591-2d7f-470f-8ec4-c037b68d077d is already attached to instances: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:19:02.607915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-faf5b911-7f43-445c-97a4-48ca4a0d5716 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113569 Jul 26 17:19:02.607915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 340/741] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:19:02 2022] POST /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 17:19:02.678492 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-453c1706-a5cb-4b98-8421-91d994608c1b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:02.679177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-453c1706-a5cb-4b98-8421-91d994608c1b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:02.685962 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-453c1706-a5cb-4b98-8421-91d994608c1b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:02.686403 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-453c1706-a5cb-4b98-8421-91d994608c1b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:02.687184 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-453c1706-a5cb-4b98-8421-91d994608c1b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:02.687614 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-453c1706-a5cb-4b98-8421-91d994608c1b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:02.774625 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-453c1706-a5cb-4b98-8421-91d994608c1b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lazy-loading 'services' on Instance uuid 8c1e9557-fc15-4ea5-9b93-de135b76dfeb {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:19:02.853788 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-453c1706-a5cb-4b98-8421-91d994608c1b tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments/6f5af591-2d7f-470f-8ec4-c037b68d077d" status: 202 len: 0 microversion: 2.1 time: 0.180844 Jul 26 17:19:02.854552 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 402/742] 10.222.0.48 () {58 vars in 1416 bytes} [Tue Jul 26 17:19:02 2022] DELETE /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments/6f5af591-2d7f-470f-8ec4-c037b68d077d => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:19:02.863672 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-cb10305f-030b-475b-9334-d54bd1bd27e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:02.866018 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-cb10305f-030b-475b-9334-d54bd1bd27e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:02.873518 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cb10305f-030b-475b-9334-d54bd1bd27e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:02.874017 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cb10305f-030b-475b-9334-d54bd1bd27e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:02.874961 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cb10305f-030b-475b-9334-d54bd1bd27e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:02.875400 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cb10305f-030b-475b-9334-d54bd1bd27e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:02.907040 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-cb10305f-030b-475b-9334-d54bd1bd27e9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047504 Jul 26 17:19:02.907634 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 341/743] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:19:02 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:03.724473 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-708f1a03-04ee-44ba-91be-338f171dac07 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:03.725087 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-708f1a03-04ee-44ba-91be-338f171dac07 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:03.732185 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-708f1a03-04ee-44ba-91be-338f171dac07 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:03.732641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-708f1a03-04ee-44ba-91be-338f171dac07 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:03.733462 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-708f1a03-04ee-44ba-91be-338f171dac07 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:03.733910 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-708f1a03-04ee-44ba-91be-338f171dac07 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:03.823867 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-708f1a03-04ee-44ba-91be-338f171dac07 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lazy-loading 'services' on Instance uuid 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:19:03.899385 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-708f1a03-04ee-44ba-91be-338f171dac07 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments/aca78baa-aea6-4863-b4f5-7b62d8825346" status: 202 len: 0 microversion: 2.1 time: 0.179559 Jul 26 17:19:03.900238 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 403/744] 10.222.0.48 () {58 vars in 1416 bytes} [Tue Jul 26 17:19:03 2022] DELETE /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments/aca78baa-aea6-4863-b4f5-7b62d8825346 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:19:03.911616 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-336eae6b-5983-4d5e-8fc7-abdc1e39a8d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:03.914868 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-336eae6b-5983-4d5e-8fc7-abdc1e39a8d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:03.923242 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-336eae6b-5983-4d5e-8fc7-abdc1e39a8d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:03.923794 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-889b1db0-d1ad-44ec-8d76-9a91f9e35208 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:03.924461 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-336eae6b-5983-4d5e-8fc7-abdc1e39a8d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:03.925524 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-336eae6b-5983-4d5e-8fc7-abdc1e39a8d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:03.926258 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-336eae6b-5983-4d5e-8fc7-abdc1e39a8d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:03.926513 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-889b1db0-d1ad-44ec-8d76-9a91f9e35208 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:03.934997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-889b1db0-d1ad-44ec-8d76-9a91f9e35208 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:03.935452 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-889b1db0-d1ad-44ec-8d76-9a91f9e35208 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:03.936515 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-889b1db0-d1ad-44ec-8d76-9a91f9e35208 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:03.937234 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-889b1db0-d1ad-44ec-8d76-9a91f9e35208 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:03.968949 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-336eae6b-5983-4d5e-8fc7-abdc1e39a8d8 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062797 Jul 26 17:19:03.969889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 342/745] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:19:03 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:03.974930 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-889b1db0-d1ad-44ec-8d76-9a91f9e35208 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058799 Jul 26 17:19:03.975665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 404/746] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:19:03 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:19:04.984818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-153f0662-311f-460b-9e11-292069298208 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:04.987225 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-153f0662-311f-460b-9e11-292069298208 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:04.992419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d33dcfbd-ea92-44de-8f90-8794e6ea30a4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:04.994331 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-153f0662-311f-460b-9e11-292069298208 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:04.995307 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-153f0662-311f-460b-9e11-292069298208 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:04.996143 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-153f0662-311f-460b-9e11-292069298208 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:04.996575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-153f0662-311f-460b-9e11-292069298208 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:04.997572 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d33dcfbd-ea92-44de-8f90-8794e6ea30a4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:05.008885 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d33dcfbd-ea92-44de-8f90-8794e6ea30a4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:05.012446 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d33dcfbd-ea92-44de-8f90-8794e6ea30a4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:05.012446 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d33dcfbd-ea92-44de-8f90-8794e6ea30a4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:05.012837 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d33dcfbd-ea92-44de-8f90-8794e6ea30a4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:05.031019 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-153f0662-311f-460b-9e11-292069298208 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050331 Jul 26 17:19:05.035589 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 343/747] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:19:04 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:05.060198 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d33dcfbd-ea92-44de-8f90-8794e6ea30a4 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074248 Jul 26 17:19:05.060903 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 405/748] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:19:04 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 17:19:05.131634 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9f948f26-b78f-468b-819e-c74172e41627 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:05.132136 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9f948f26-b78f-468b-819e-c74172e41627 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:05.140015 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9f948f26-b78f-468b-819e-c74172e41627 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:05.140468 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9f948f26-b78f-468b-819e-c74172e41627 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:05.141298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9f948f26-b78f-468b-819e-c74172e41627 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:05.141749 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9f948f26-b78f-468b-819e-c74172e41627 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:05.169418 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9f948f26-b78f-468b-819e-c74172e41627 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Going to try to terminate instance {{(pid=118122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:19:05.265059 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9f948f26-b78f-468b-819e-c74172e41627 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 204 len: 0 microversion: 2.1 time: 0.136805 Jul 26 17:19:05.265580 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 344/749] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:19:05 2022] DELETE /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:19:05.274377 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c7cde72e-84da-43d0-bc4d-7c5e303138f7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:05.274992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c7cde72e-84da-43d0-bc4d-7c5e303138f7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:05.281605 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7cde72e-84da-43d0-bc4d-7c5e303138f7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:05.282057 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7cde72e-84da-43d0-bc4d-7c5e303138f7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:05.282856 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7cde72e-84da-43d0-bc4d-7c5e303138f7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:05.283290 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7cde72e-84da-43d0-bc4d-7c5e303138f7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:05.428349 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c7cde72e-84da-43d0-bc4d-7c5e303138f7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:05.436561 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c7cde72e-84da-43d0-bc4d-7c5e303138f7 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1680 microversion: 2.1 time: 0.166371 Jul 26 17:19:05.437172 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 406/750] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:05 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:19:06.044795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-70640d49-b949-40d7-a601-90110a5525bc tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:06.047102 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-70640d49-b949-40d7-a601-90110a5525bc tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:06.054154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-70640d49-b949-40d7-a601-90110a5525bc tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:06.054606 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-70640d49-b949-40d7-a601-90110a5525bc tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:06.055394 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-70640d49-b949-40d7-a601-90110a5525bc tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:06.055829 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-70640d49-b949-40d7-a601-90110a5525bc tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:06.091359 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-70640d49-b949-40d7-a601-90110a5525bc tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051069 Jul 26 17:19:06.092062 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 345/751] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:19:06 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 17:19:06.179242 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-73fa154a-cef6-4580-b7ac-a492f88f288d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:06.179794 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-73fa154a-cef6-4580-b7ac-a492f88f288d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:06.188125 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73fa154a-cef6-4580-b7ac-a492f88f288d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:06.188578 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73fa154a-cef6-4580-b7ac-a492f88f288d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:06.189390 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73fa154a-cef6-4580-b7ac-a492f88f288d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:06.189837 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73fa154a-cef6-4580-b7ac-a492f88f288d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:06.192780 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:06.220665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-73fa154a-cef6-4580-b7ac-a492f88f288d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:19:06.318546 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-73fa154a-cef6-4580-b7ac-a492f88f288d tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 204 len: 0 microversion: 2.1 time: 0.142925 Jul 26 17:19:06.319182 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 407/752] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:19:06 2022] DELETE /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 17:19:06.332204 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b67fd871-a325-4d9e-b7ef-61f1a21ad41f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:06.333193 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b67fd871-a325-4d9e-b7ef-61f1a21ad41f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:06.341115 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b67fd871-a325-4d9e-b7ef-61f1a21ad41f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:06.341567 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b67fd871-a325-4d9e-b7ef-61f1a21ad41f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:06.342340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b67fd871-a325-4d9e-b7ef-61f1a21ad41f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:06.342773 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b67fd871-a325-4d9e-b7ef-61f1a21ad41f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:06.457950 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6567cda2-b4d7-4489-a17e-cc7582f05576 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:06.458758 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6567cda2-b4d7-4489-a17e-cc7582f05576 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:06.465904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6567cda2-b4d7-4489-a17e-cc7582f05576 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:06.466359 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6567cda2-b4d7-4489-a17e-cc7582f05576 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:06.467142 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6567cda2-b4d7-4489-a17e-cc7582f05576 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:06.467576 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6567cda2-b4d7-4489-a17e-cc7582f05576 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:06.483644 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-b67fd871-a325-4d9e-b7ef-61f1a21ad41f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:06.492074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b67fd871-a325-4d9e-b7ef-61f1a21ad41f tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1691 microversion: 2.1 time: 0.166254 Jul 26 17:19:06.493162 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 346/753] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:06 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:06.630209 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6567cda2-b4d7-4489-a17e-cc7582f05576 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:06.640753 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6567cda2-b4d7-4489-a17e-cc7582f05576 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1680 microversion: 2.1 time: 0.186846 Jul 26 17:19:06.641553 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 408/754] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:06 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:19:07.524141 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1b838ca6-0310-43f9-b9ca-0969ea9c19da tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:07.524735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1b838ca6-0310-43f9-b9ca-0969ea9c19da tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:07.532323 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b838ca6-0310-43f9-b9ca-0969ea9c19da tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:07.532757 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b838ca6-0310-43f9-b9ca-0969ea9c19da tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:07.533575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b838ca6-0310-43f9-b9ca-0969ea9c19da tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:07.534008 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b838ca6-0310-43f9-b9ca-0969ea9c19da tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:07.668435 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1652e1c3-f7ea-4767-858d-e39169104b20 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:07.669525 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1652e1c3-f7ea-4767-858d-e39169104b20 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:07.678370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1652e1c3-f7ea-4767-858d-e39169104b20 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:07.678817 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1652e1c3-f7ea-4767-858d-e39169104b20 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:07.679594 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1652e1c3-f7ea-4767-858d-e39169104b20 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:07.680029 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1652e1c3-f7ea-4767-858d-e39169104b20 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:07.688096 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1b838ca6-0310-43f9-b9ca-0969ea9c19da tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:07.696511 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1b838ca6-0310-43f9-b9ca-0969ea9c19da tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1691 microversion: 2.1 time: 0.176629 Jul 26 17:19:07.697399 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 347/755] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:07 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:07.825516 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1652e1c3-f7ea-4767-858d-e39169104b20 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:07.833552 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1652e1c3-f7ea-4767-858d-e39169104b20 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1680 microversion: 2.1 time: 0.173490 Jul 26 17:19:07.834137 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 409/756] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:07 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:08.718185 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-27cd761b-0c67-4a59-ae70-b6a823c970e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:08.718791 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-27cd761b-0c67-4a59-ae70-b6a823c970e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:08.725062 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-27cd761b-0c67-4a59-ae70-b6a823c970e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:08.725513 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-27cd761b-0c67-4a59-ae70-b6a823c970e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:08.726285 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-27cd761b-0c67-4a59-ae70-b6a823c970e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:08.726718 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-27cd761b-0c67-4a59-ae70-b6a823c970e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:08.729687 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:08.857185 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2e552ee6-389f-4970-b12f-64b7c669c757 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:08.857793 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2e552ee6-389f-4970-b12f-64b7c669c757 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:08.868325 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e552ee6-389f-4970-b12f-64b7c669c757 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:08.869191 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e552ee6-389f-4970-b12f-64b7c669c757 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:08.871603 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e552ee6-389f-4970-b12f-64b7c669c757 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:08.872646 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e552ee6-389f-4970-b12f-64b7c669c757 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:08.876485 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-27cd761b-0c67-4a59-ae70-b6a823c970e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:08.884360 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-27cd761b-0c67-4a59-ae70-b6a823c970e5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1691 microversion: 2.1 time: 0.170439 Jul 26 17:19:08.884951 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 348/757] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:08 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:19:09.022890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2e552ee6-389f-4970-b12f-64b7c669c757 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:09.030691 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2e552ee6-389f-4970-b12f-64b7c669c757 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1680 microversion: 2.1 time: 0.178505 Jul 26 17:19:09.031269 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 410/758] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:08 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:09.907272 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-684efc60-3c15-4f08-a4c3-3496203ffc9a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:09.908063 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-684efc60-3c15-4f08-a4c3-3496203ffc9a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:09.915573 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-684efc60-3c15-4f08-a4c3-3496203ffc9a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:09.916056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-684efc60-3c15-4f08-a4c3-3496203ffc9a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:09.917426 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-684efc60-3c15-4f08-a4c3-3496203ffc9a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:09.917864 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-684efc60-3c15-4f08-a4c3-3496203ffc9a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:10.052646 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-99616b17-0ead-41e9-a308-05a760750b3f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:10.053399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-99616b17-0ead-41e9-a308-05a760750b3f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:10.061895 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99616b17-0ead-41e9-a308-05a760750b3f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:10.062548 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99616b17-0ead-41e9-a308-05a760750b3f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:10.063488 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99616b17-0ead-41e9-a308-05a760750b3f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:10.064113 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99616b17-0ead-41e9-a308-05a760750b3f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:10.067053 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-684efc60-3c15-4f08-a4c3-3496203ffc9a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:10.076036 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-684efc60-3c15-4f08-a4c3-3496203ffc9a tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1691 microversion: 2.1 time: 0.172655 Jul 26 17:19:10.076861 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 349/759] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:09 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:10.367560 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-99616b17-0ead-41e9-a308-05a760750b3f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:10.378041 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-99616b17-0ead-41e9-a308-05a760750b3f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1680 microversion: 2.1 time: 0.329755 Jul 26 17:19:10.378625 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 411/760] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:10 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1680 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:11.099447 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5733264a-69dc-4bf0-8afe-b2395108fcc9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:11.100081 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5733264a-69dc-4bf0-8afe-b2395108fcc9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:11.107861 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5733264a-69dc-4bf0-8afe-b2395108fcc9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:11.108314 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5733264a-69dc-4bf0-8afe-b2395108fcc9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:11.109148 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5733264a-69dc-4bf0-8afe-b2395108fcc9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:11.110510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5733264a-69dc-4bf0-8afe-b2395108fcc9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:11.259768 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5733264a-69dc-4bf0-8afe-b2395108fcc9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:11.267657 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5733264a-69dc-4bf0-8afe-b2395108fcc9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1691 microversion: 2.1 time: 0.172127 Jul 26 17:19:11.268535 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 350/761] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:11 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:11.404402 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8f060a86-06f2-403e-9fa1-ef75d5f6a94c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:11.406165 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8f060a86-06f2-403e-9fa1-ef75d5f6a94c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:11.412887 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f060a86-06f2-403e-9fa1-ef75d5f6a94c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:11.413390 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f060a86-06f2-403e-9fa1-ef75d5f6a94c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:11.414176 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f060a86-06f2-403e-9fa1-ef75d5f6a94c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:11.415145 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f060a86-06f2-403e-9fa1-ef75d5f6a94c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:11.816588 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8f060a86-06f2-403e-9fa1-ef75d5f6a94c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:11.825552 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8f060a86-06f2-403e-9fa1-ef75d5f6a94c tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1680 microversion: 2.1 time: 0.429591 Jul 26 17:19:11.826217 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 412/762] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:11 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1680 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:12.291324 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ca646050-4032-48b3-b12b-da51873320a5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:12.291996 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ca646050-4032-48b3-b12b-da51873320a5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:12.300320 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ca646050-4032-48b3-b12b-da51873320a5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:12.300905 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ca646050-4032-48b3-b12b-da51873320a5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:12.301815 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ca646050-4032-48b3-b12b-da51873320a5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:12.302623 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ca646050-4032-48b3-b12b-da51873320a5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:12.403022 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ca646050-4032-48b3-b12b-da51873320a5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:12.423558 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ca646050-4032-48b3-b12b-da51873320a5 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1623 microversion: 2.1 time: 0.136872 Jul 26 17:19:12.425059 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 351/763] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:12 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1623 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:12.747884 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-159aa645-e7c7-4b09-b520-130d4137166f req-8c9eafe3-fd96-45d9-8ade-83567ec8cd6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1e9557-fc15-4ea5-9b93-de135b76dfeb", "name": "network-vif-deleted", "tag": "31c721ef-3c46-4353-858f-597f80f0ca60"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:12.763782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-159aa645-e7c7-4b09-b520-130d4137166f req-8c9eafe3-fd96-45d9-8ade-83567ec8cd6c service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:12.765032 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-159aa645-e7c7-4b09-b520-130d4137166f req-8c9eafe3-fd96-45d9-8ade-83567ec8cd6c service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:12.782173 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-159aa645-e7c7-4b09-b520-130d4137166f req-8c9eafe3-fd96-45d9-8ade-83567ec8cd6c service nova] Creating event network-vif-deleted:31c721ef-3c46-4353-858f-597f80f0ca60 for instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb on hv-cinder-83538 Jul 26 17:19:12.790954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-159aa645-e7c7-4b09-b520-130d4137166f req-8c9eafe3-fd96-45d9-8ade-83567ec8cd6c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048996 Jul 26 17:19:12.793375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 413/764] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:12.852738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3583d624-61c9-4330-b31c-717d5093be52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:12.853389 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3583d624-61c9-4330-b31c-717d5093be52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:12.865389 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3583d624-61c9-4330-b31c-717d5093be52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:12.867160 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3583d624-61c9-4330-b31c-717d5093be52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:12.868385 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3583d624-61c9-4330-b31c-717d5093be52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:12.869024 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3583d624-61c9-4330-b31c-717d5093be52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:12.963930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3583d624-61c9-4330-b31c-717d5093be52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:12.972703 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3583d624-61c9-4330-b31c-717d5093be52 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 200 len: 1326 microversion: 2.1 time: 0.124050 Jul 26 17:19:12.974333 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 352/765] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:12 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 1326 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:19:13.459060 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-509972f8-b462-499a-89dd-221c69747d54 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:13.460889 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-509972f8-b462-499a-89dd-221c69747d54 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:13.471025 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-509972f8-b462-499a-89dd-221c69747d54 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:13.471684 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-509972f8-b462-499a-89dd-221c69747d54 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:13.473004 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-509972f8-b462-499a-89dd-221c69747d54 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:13.473584 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-509972f8-b462-499a-89dd-221c69747d54 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:13.512837 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-509972f8-b462-499a-89dd-221c69747d54 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:13.513323 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-509972f8-b462-499a-89dd-221c69747d54 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:13.513808 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-509972f8-b462-499a-89dd-221c69747d54 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lazy-loading 'fault' on Instance uuid 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:19:13.563944 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-509972f8-b462-499a-89dd-221c69747d54 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:13.574595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-509972f8-b462-499a-89dd-221c69747d54 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 200 len: 1336 microversion: 2.1 time: 0.119888 Jul 26 17:19:13.575187 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 414/766] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:13 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 1336 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:19:14.013344 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-cc367293-d330-48a0-af22-bdca190d2f36 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:14.014042 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-cc367293-d330-48a0-af22-bdca190d2f36 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:14.022832 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cc367293-d330-48a0-af22-bdca190d2f36 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:14.023096 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cc367293-d330-48a0-af22-bdca190d2f36 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:14.024062 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cc367293-d330-48a0-af22-bdca190d2f36 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:14.024499 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-cc367293-d330-48a0-af22-bdca190d2f36 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:14.039907 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-cc367293-d330-48a0-af22-bdca190d2f36 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-cc367293-d330-48a0-af22-bdca190d2f36 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb HTTP/1.1 Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:19:14.042427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:19:14.044293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:19:14.044293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:19:14.044293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:19:14.044293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:19:14.044293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:19:14.044293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:19:14.044293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:19:14.044293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:19:14.044293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:19:14.044293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:19:14.044293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:19:14.044293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '8c1e9557-fc15-4ea5-9b93-de135b76dfeb'} Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:19:14.045159 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:19:14.046388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:14.047462 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-cc367293-d330-48a0-af22-bdca190d2f36 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 404 to user: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:19:14.047462 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-cc367293-d330-48a0-af22-bdca190d2f36 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 404 len: 111 microversion: 2.1 time: 0.035486 Jul 26 17:19:14.047462 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 353/767] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:14 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:19:14.053068 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fc1f7812-20d1-4cbd-af82-7ba3154b868a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '.version_select at 0x7f6ca88fbb80>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:14.078125 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fc1f7812-20d1-4cbd-af82-7ba3154b868a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642786410" status: 202 len: 0 microversion: 2.1 time: 0.028869 Jul 26 17:19:14.082075 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 415/768] 10.222.0.48 () {58 vars in 1221 bytes} [Tue Jul 26 17:19:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642786410 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:19:14.595681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c6e6ca51-57dc-4852-9f23-9f3bc44b46a1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:14.599191 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c6e6ca51-57dc-4852-9f23-9f3bc44b46a1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:14.603555 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c6e6ca51-57dc-4852-9f23-9f3bc44b46a1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:14.604272 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c6e6ca51-57dc-4852-9f23-9f3bc44b46a1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:14.605083 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c6e6ca51-57dc-4852-9f23-9f3bc44b46a1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:14.605523 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c6e6ca51-57dc-4852-9f23-9f3bc44b46a1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:14.622443 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-c6e6ca51-57dc-4852-9f23-9f3bc44b46a1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] HTTP exception thrown: Instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce could not be found. Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c6e6ca51-57dc-4852-9f23-9f3bc44b46a1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Request method failure captured: Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce HTTP/1.1 Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CC2x0eKkH9UXJgkwe-DjkCoDqloc4SydbPTIUNwkQQ0_-ouZD4LJcioqLwoynbj5fwOQ8ZgXQWu3c-hjOZFFvdgy6I-P1cEeLqhJgW3KkQqc5QCS1kbQ00kpGZ1KpgwuursPfQkB8oQIc4wtw4pQzOfyKY8lCWGfdT8KOsp-1vwtAw Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 2b8b6c88af94417c840fdafd1fe431b7 Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:19:14.624051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:19:14.626003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:19:14.626003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:19:14.626003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 2b8b6c88af94417c840fdafd1fe431b7 Jul 26 17:19:14.626003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:19:14.626003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-ServerRescueNegativeTestJSON-894760419-project Jul 26 17:19:14.626003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:19:14.626003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:19:14.626003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: 97115d07acc5464bb7b097039471fee6 Jul 26 17:19:14.626003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894760419-project Jul 26 17:19:14.626003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:19:14.626003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce could not be found. Jul 26 17:19:14.626003 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '7701e238-d4bd-4e91-9ae9-9a5845f8a1ce'} Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce could not be found. Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:19:14.626948 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce could not be found. Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce could not be found. Jul 26 17:19:14.628134 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:14.629278 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c6e6ca51-57dc-4852-9f23-9f3bc44b46a1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Returning 404 to user: Instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:19:14.629278 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c6e6ca51-57dc-4852-9f23-9f3bc44b46a1 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce" status: 404 len: 111 microversion: 2.1 time: 0.033811 Jul 26 17:19:14.629278 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 354/769] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:14 2022] GET /compute/v2.1/servers/7701e238-d4bd-4e91-9ae9-9a5845f8a1ce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 17:19:14.644579 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ebefe30f-fe05-4422-b317-ab0236074ec9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '.version_select at 0x7f6ca894e550>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:14.673598 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ebefe30f-fe05-4422-b317-ab0236074ec9 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1252820637" status: 202 len: 0 microversion: 2.1 time: 0.032933 Jul 26 17:19:14.677791 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 416/770] 10.222.0.48 () {58 vars in 1221 bytes} [Tue Jul 26 17:19:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1252820637 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:19:14.753392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0974b693-08bd-4577-8f4b-8efa40de9825 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: .version_select at 0x7f6ca91b4d30>, body: {"keypair": {"name": "tempest-keypair-1857666756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD196JVOShGINyYrHXjbtRezadqwKhepi21fz9oJovklbPlZxvjg3uej9iJoD8woDTqs6u+KAewOMvkEG9jQvgAtqnXkuwidIx7q53sMP4vrM0IkOpVgTp5cmBVjwCKgrQ=="}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:14.769565 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-0974b693-08bd-4577-8f4b-8efa40de9825 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:19:14.775974 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-0974b693-08bd-4577-8f4b-8efa40de9825 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for user c6291932ceb84b03924c0f056f29c2a9 and project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:19:14.804066 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0974b693-08bd-4577-8f4b-8efa40de9825 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054450 Jul 26 17:19:14.805976 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 355/771] 10.222.0.48 () {60 vars in 1159 bytes} [Tue Jul 26 17:19:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:14.810280 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-78bb91ac-076b-4430-b1be-3aa4a75de206 req-2bd6b252-6cf1-47f5-86d7-b05beea1b715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7701e238-d4bd-4e91-9ae9-9a5845f8a1ce", "name": "network-vif-deleted", "tag": "d2849b37-4de3-40c3-97ec-d1f87c72f88f"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:14.820077 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-78bb91ac-076b-4430-b1be-3aa4a75de206 req-2bd6b252-6cf1-47f5-86d7-b05beea1b715 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:14.820518 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-78bb91ac-076b-4430-b1be-3aa4a75de206 req-2bd6b252-6cf1-47f5-86d7-b05beea1b715 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:14.831971 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-78bb91ac-076b-4430-b1be-3aa4a75de206 req-2bd6b252-6cf1-47f5-86d7-b05beea1b715 service nova] Creating event network-vif-deleted:d2849b37-4de3-40c3-97ec-d1f87c72f88f for instance 7701e238-d4bd-4e91-9ae9-9a5845f8a1ce on hv-cinder-83538 Jul 26 17:19:14.837251 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-78bb91ac-076b-4430-b1be-3aa4a75de206 req-2bd6b252-6cf1-47f5-86d7-b05beea1b715 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031877 Jul 26 17:19:14.838175 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 417/772] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:16.449825 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-849794657", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "734c8f5e-6756-4577-8da6-4e85b95dd0b0"}], "security_groups": [{"name": "tempest-securitygroup--176526167"}], "key_name": "tempest-keypair-1857666756", "user_data": "}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:16.555946 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.network.neutron [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] validate_networks() for [('734c8f5e-6756-4577-8da6-4e85b95dd0b0', None, None, None, None, None)] {{(pid=118122) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:19:16.957970 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Flavor limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:19:16.958421 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Image limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:19:16.958898 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Flavor pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:19:16.959309 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Image pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:19:16.959723 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:19:16.969376 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:16.969830 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:16.970652 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:16.971174 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:16.989456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:19:16.993432 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Getting quotas for user c6291932ceb84b03924c0f056f29c2a9 and project 446eaae0a4f34eba86d4b0de0c2d1013. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:19:17.006565 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Going to run 1 instances... {{(pid=118122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:19:17.008829 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:19:17.060480 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-86000694-04ae-4405-ba83-ce1948d314f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.616218 Jul 26 17:19:17.061158 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 356/773] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:19:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 17:19:17.073020 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f28dc8bf-a61a-43d3-95f4-a502600b61f8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:17.074652 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f28dc8bf-a61a-43d3-95f4-a502600b61f8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:17.389399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f28dc8bf-a61a-43d3-95f4-a502600b61f8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:17.396295 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f28dc8bf-a61a-43d3-95f4-a502600b61f8 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1241 microversion: 2.1 time: 0.327962 Jul 26 17:19:17.397009 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 418/774] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:17 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1241 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:17.873686 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-335a6763-420f-48a8-a68a-37c697b30377 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:17.874186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-335a6763-420f-48a8-a68a-37c697b30377 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:17.881602 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-335a6763-420f-48a8-a68a-37c697b30377 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:17.882056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-335a6763-420f-48a8-a68a-37c697b30377 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:17.882831 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-335a6763-420f-48a8-a68a-37c697b30377 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:17.883267 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-335a6763-420f-48a8-a68a-37c697b30377 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:17.908443 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-335a6763-420f-48a8-a68a-37c697b30377 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Going to try to terminate instance {{(pid=118122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:19:18.006971 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-335a6763-420f-48a8-a68a-37c697b30377 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 204 len: 0 microversion: 2.1 time: 0.137993 Jul 26 17:19:18.007701 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 357/775] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:19:17 2022] DELETE /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:19:18.016671 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7507fbd0-f7a6-4ead-a7dc-7d778b715516 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:18.017312 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7507fbd0-f7a6-4ead-a7dc-7d778b715516 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:18.023485 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7507fbd0-f7a6-4ead-a7dc-7d778b715516 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:18.023928 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7507fbd0-f7a6-4ead-a7dc-7d778b715516 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:18.024683 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7507fbd0-f7a6-4ead-a7dc-7d778b715516 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:18.025156 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7507fbd0-f7a6-4ead-a7dc-7d778b715516 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:18.176389 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7507fbd0-f7a6-4ead-a7dc-7d778b715516 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:18.185778 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7507fbd0-f7a6-4ead-a7dc-7d778b715516 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1509 microversion: 2.1 time: 0.172740 Jul 26 17:19:18.186361 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 419/776] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:18 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:19:18.419078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-675d8ee3-ce5a-4cf9-8b2f-ef19d910ecc9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:18.419827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-675d8ee3-ce5a-4cf9-8b2f-ef19d910ecc9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:18.426013 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-675d8ee3-ce5a-4cf9-8b2f-ef19d910ecc9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:18.426463 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-675d8ee3-ce5a-4cf9-8b2f-ef19d910ecc9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:18.427240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-675d8ee3-ce5a-4cf9-8b2f-ef19d910ecc9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:18.427675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-675d8ee3-ce5a-4cf9-8b2f-ef19d910ecc9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:18.504133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-675d8ee3-ce5a-4cf9-8b2f-ef19d910ecc9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:18.512166 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-675d8ee3-ce5a-4cf9-8b2f-ef19d910ecc9 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1301 microversion: 2.1 time: 0.097557 Jul 26 17:19:18.512813 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 358/777] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:18 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:19.208935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5c0710a1-9c1a-4add-bb5a-ca625989c119 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:19.209634 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5c0710a1-9c1a-4add-bb5a-ca625989c119 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:19.217543 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c0710a1-9c1a-4add-bb5a-ca625989c119 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:19.217990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c0710a1-9c1a-4add-bb5a-ca625989c119 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:19.218761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c0710a1-9c1a-4add-bb5a-ca625989c119 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:19.219189 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c0710a1-9c1a-4add-bb5a-ca625989c119 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:19.469311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5c0710a1-9c1a-4add-bb5a-ca625989c119 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:19.477305 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5c0710a1-9c1a-4add-bb5a-ca625989c119 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1509 microversion: 2.1 time: 0.272136 Jul 26 17:19:19.477887 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 420/778] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:19 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:19.534043 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7f09d783-84bc-4c33-9582-b6d96cb1407e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:19.534739 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7f09d783-84bc-4c33-9582-b6d96cb1407e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:19.537243 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:19.543132 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7f09d783-84bc-4c33-9582-b6d96cb1407e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:19.543582 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7f09d783-84bc-4c33-9582-b6d96cb1407e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:19.544348 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7f09d783-84bc-4c33-9582-b6d96cb1407e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:19.544778 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7f09d783-84bc-4c33-9582-b6d96cb1407e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:19.610358 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7f09d783-84bc-4c33-9582-b6d96cb1407e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:19.623333 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7f09d783-84bc-4c33-9582-b6d96cb1407e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1299 microversion: 2.1 time: 0.093043 Jul 26 17:19:19.623918 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 359/779] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:19 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:20.493959 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-c7a4c53e-874d-4d26-be39-16a2e12e6f16 req-8c156523-943e-4db7-b68e-5d0fb6e372e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6013d114-1110-4e9d-91c2-f4979c5630a8", "name": "network-vif-deleted", "tag": "6aa02a88-be55-4444-81d7-64bb4a29e88d"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:20.500825 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6d1ff81f-1617-4a3b-a857-35184385c45b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:20.501480 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6d1ff81f-1617-4a3b-a857-35184385c45b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:20.509205 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6d1ff81f-1617-4a3b-a857-35184385c45b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:20.509696 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6d1ff81f-1617-4a3b-a857-35184385c45b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:20.510968 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6d1ff81f-1617-4a3b-a857-35184385c45b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:20.512062 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6d1ff81f-1617-4a3b-a857-35184385c45b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:20.514509 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-c7a4c53e-874d-4d26-be39-16a2e12e6f16 req-8c156523-943e-4db7-b68e-5d0fb6e372e5 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:20.515421 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-c7a4c53e-874d-4d26-be39-16a2e12e6f16 req-8c156523-943e-4db7-b68e-5d0fb6e372e5 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:20.530332 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-c7a4c53e-874d-4d26-be39-16a2e12e6f16 req-8c156523-943e-4db7-b68e-5d0fb6e372e5 service nova] Creating event network-vif-deleted:6aa02a88-be55-4444-81d7-64bb4a29e88d for instance 6013d114-1110-4e9d-91c2-f4979c5630a8 on hv-cinder-83538 Jul 26 17:19:20.536591 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-c7a4c53e-874d-4d26-be39-16a2e12e6f16 req-8c156523-943e-4db7-b68e-5d0fb6e372e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047356 Jul 26 17:19:20.537620 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 421/780] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:20.589061 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6d1ff81f-1617-4a3b-a857-35184385c45b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:20.602796 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6d1ff81f-1617-4a3b-a857-35184385c45b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 200 len: 1467 microversion: 2.1 time: 0.106164 Jul 26 17:19:20.603889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 360/781] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:20 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 1467 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:19:20.646572 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f184c8a4-32ff-4a49-b30d-8d074c7b01cc tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:20.648810 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f184c8a4-32ff-4a49-b30d-8d074c7b01cc tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:20.661883 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f184c8a4-32ff-4a49-b30d-8d074c7b01cc tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:20.662279 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f184c8a4-32ff-4a49-b30d-8d074c7b01cc tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:20.663088 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f184c8a4-32ff-4a49-b30d-8d074c7b01cc tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:20.663705 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f184c8a4-32ff-4a49-b30d-8d074c7b01cc tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:20.826622 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f184c8a4-32ff-4a49-b30d-8d074c7b01cc tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:20.834921 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f184c8a4-32ff-4a49-b30d-8d074c7b01cc tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1366 microversion: 2.1 time: 0.193729 Jul 26 17:19:20.836197 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 422/782] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:20 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:21.623827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c1e374aa-7daa-4859-92a6-190342e9aca6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:21.625625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c1e374aa-7daa-4859-92a6-190342e9aca6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 6013d114-1110-4e9d-91c2-f4979c5630a8] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:21.637466 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1e374aa-7daa-4859-92a6-190342e9aca6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:21.638285 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1e374aa-7daa-4859-92a6-190342e9aca6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:21.639277 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1e374aa-7daa-4859-92a6-190342e9aca6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:21.639889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1e374aa-7daa-4859-92a6-190342e9aca6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:21.656657 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-c1e374aa-7daa-4859-92a6-190342e9aca6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] HTTP exception thrown: Instance 6013d114-1110-4e9d-91c2-f4979c5630a8 could not be found. Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c1e374aa-7daa-4859-92a6-190342e9aca6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Request method failure captured: Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 HTTP/1.1 Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CC2x0eKkH9UXJgkwe-DjkCoDqloc4SydbPTIUNwkQQ0_-ouZD4LJcioqLwoynbj5fwOQ8ZgXQWu3c-hjOZFFvdgy6I-P1cEeLqhJgW3KkQqc5QCS1kbQ00kpGZ1KpgwuursPfQkB8oQIc4wtw4pQzOfyKY8lCWGfdT8KOsp-1vwtAw Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 2b8b6c88af94417c840fdafd1fe431b7 Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:19:21.658428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:19:21.660424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:19:21.660424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:19:21.660424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 2b8b6c88af94417c840fdafd1fe431b7 Jul 26 17:19:21.660424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:19:21.660424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-ServerRescueNegativeTestJSON-894760419-project Jul 26 17:19:21.660424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:19:21.660424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:19:21.660424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: 97115d07acc5464bb7b097039471fee6 Jul 26 17:19:21.660424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894760419-project Jul 26 17:19:21.660424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:19:21.660424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 6013d114-1110-4e9d-91c2-f4979c5630a8 could not be found. Jul 26 17:19:21.660424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '6013d114-1110-4e9d-91c2-f4979c5630a8'} Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6013d114-1110-4e9d-91c2-f4979c5630a8 could not be found. Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:19:21.661361 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6013d114-1110-4e9d-91c2-f4979c5630a8 could not be found. Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6013d114-1110-4e9d-91c2-f4979c5630a8 could not be found. Jul 26 17:19:21.662893 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:21.664201 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c1e374aa-7daa-4859-92a6-190342e9aca6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Returning 404 to user: Instance 6013d114-1110-4e9d-91c2-f4979c5630a8 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:19:21.664201 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c1e374aa-7daa-4859-92a6-190342e9aca6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8" status: 404 len: 111 microversion: 2.1 time: 0.040159 Jul 26 17:19:21.664201 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 361/783] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:21 2022] GET /compute/v2.1/servers/6013d114-1110-4e9d-91c2-f4979c5630a8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:19:21.669830 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bc5c00e2-b566-4546-a869-9feda837d980 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:21.670395 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bc5c00e2-b566-4546-a869-9feda837d980 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:21.677283 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc5c00e2-b566-4546-a869-9feda837d980 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:21.677730 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc5c00e2-b566-4546-a869-9feda837d980 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:21.678510 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc5c00e2-b566-4546-a869-9feda837d980 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:21.678949 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc5c00e2-b566-4546-a869-9feda837d980 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:21.707523 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bc5c00e2-b566-4546-a869-9feda837d980 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:19:21.812014 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bc5c00e2-b566-4546-a869-9feda837d980 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 204 len: 0 microversion: 2.1 time: 0.146670 Jul 26 17:19:21.813106 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 423/784] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:19:21 2022] DELETE /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 17:19:21.823088 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a48c032b-8645-431c-b851-4e7bb6536ef6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:21.823876 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a48c032b-8645-431c-b851-4e7bb6536ef6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:21.830850 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a48c032b-8645-431c-b851-4e7bb6536ef6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:21.831325 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a48c032b-8645-431c-b851-4e7bb6536ef6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:21.832123 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a48c032b-8645-431c-b851-4e7bb6536ef6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:21.832554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a48c032b-8645-431c-b851-4e7bb6536ef6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:21.857221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-db0c09e6-6fe5-44d1-a4e2-33f8443491bb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:21.857827 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-db0c09e6-6fe5-44d1-a4e2-33f8443491bb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:21.864107 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db0c09e6-6fe5-44d1-a4e2-33f8443491bb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:21.864505 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db0c09e6-6fe5-44d1-a4e2-33f8443491bb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:21.865344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db0c09e6-6fe5-44d1-a4e2-33f8443491bb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:21.865750 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db0c09e6-6fe5-44d1-a4e2-33f8443491bb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:21.973727 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a48c032b-8645-431c-b851-4e7bb6536ef6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:21.982402 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a48c032b-8645-431c-b851-4e7bb6536ef6 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.165114 Jul 26 17:19:21.982979 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 362/785] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:21 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:22.010079 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-db0c09e6-6fe5-44d1-a4e2-33f8443491bb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:22.017945 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-db0c09e6-6fe5-44d1-a4e2-33f8443491bb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1366 microversion: 2.1 time: 0.165777 Jul 26 17:19:22.018517 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 424/786] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:21 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:19:22.570659 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-676bb041-649c-493f-a5ee-bd462610308a req-2bd97679-793d-41da-bca5-25375b43e71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a382f9-1c88-4f2c-8692-d03bd154459b", "tag": "774e109c-da42-4dc8-9225-464228f56582"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:22.580917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-676bb041-649c-493f-a5ee-bd462610308a req-2bd97679-793d-41da-bca5-25375b43e71a service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:22.581399 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-676bb041-649c-493f-a5ee-bd462610308a req-2bd97679-793d-41da-bca5-25375b43e71a service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:22.592934 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-676bb041-649c-493f-a5ee-bd462610308a req-2bd97679-793d-41da-bca5-25375b43e71a service nova] Creating event network-changed:774e109c-da42-4dc8-9225-464228f56582 for instance f8a382f9-1c88-4f2c-8692-d03bd154459b on hv-cinder-83538 Jul 26 17:19:22.597670 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-676bb041-649c-493f-a5ee-bd462610308a req-2bd97679-793d-41da-bca5-25375b43e71a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030609 Jul 26 17:19:22.598345 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 363/787] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:23.006868 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d6c4e7df-9ca5-4fb5-9f92-707f3e4426d3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:23.007476 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d6c4e7df-9ca5-4fb5-9f92-707f3e4426d3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:23.015708 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6c4e7df-9ca5-4fb5-9f92-707f3e4426d3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:23.016167 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6c4e7df-9ca5-4fb5-9f92-707f3e4426d3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:23.016945 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6c4e7df-9ca5-4fb5-9f92-707f3e4426d3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:23.017403 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6c4e7df-9ca5-4fb5-9f92-707f3e4426d3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:23.020238 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:23.041587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9da365e7-ec40-41be-bf54-4013b8a476fe tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:23.042982 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9da365e7-ec40-41be-bf54-4013b8a476fe tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:23.049917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9da365e7-ec40-41be-bf54-4013b8a476fe tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:23.050369 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9da365e7-ec40-41be-bf54-4013b8a476fe tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:23.051164 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9da365e7-ec40-41be-bf54-4013b8a476fe tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:23.051604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9da365e7-ec40-41be-bf54-4013b8a476fe tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:23.169672 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d6c4e7df-9ca5-4fb5-9f92-707f3e4426d3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:23.177037 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d6c4e7df-9ca5-4fb5-9f92-707f3e4426d3 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.176455 Jul 26 17:19:23.177599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 425/788] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:22 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:23.190047 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9da365e7-ec40-41be-bf54-4013b8a476fe tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:23.197454 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9da365e7-ec40-41be-bf54-4013b8a476fe tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1366 microversion: 2.1 time: 0.162120 Jul 26 17:19:23.198008 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 364/789] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:23 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:19:24.200054 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0144d528-a375-4f42-83cb-5890c235e48b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:24.200686 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0144d528-a375-4f42-83cb-5890c235e48b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:24.203078 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:24.208483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0144d528-a375-4f42-83cb-5890c235e48b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:24.208930 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0144d528-a375-4f42-83cb-5890c235e48b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:24.209733 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0144d528-a375-4f42-83cb-5890c235e48b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:24.210162 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0144d528-a375-4f42-83cb-5890c235e48b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:24.218474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-adce164d-c918-4f11-9d33-87ee340efd37 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:24.219092 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-adce164d-c918-4f11-9d33-87ee340efd37 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:24.226018 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-adce164d-c918-4f11-9d33-87ee340efd37 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:24.226469 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-adce164d-c918-4f11-9d33-87ee340efd37 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:24.227256 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-adce164d-c918-4f11-9d33-87ee340efd37 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:24.227690 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-adce164d-c918-4f11-9d33-87ee340efd37 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:24.363772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-adce164d-c918-4f11-9d33-87ee340efd37 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:24.371907 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-adce164d-c918-4f11-9d33-87ee340efd37 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1366 microversion: 2.1 time: 0.158182 Jul 26 17:19:24.372482 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 365/790] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:24 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:19:24.385170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0144d528-a375-4f42-83cb-5890c235e48b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:24.400531 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0144d528-a375-4f42-83cb-5890c235e48b tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1521 microversion: 2.1 time: 0.204931 Jul 26 17:19:24.401242 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 426/791] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:24 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:25.038588 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-83dd8741-b349-480b-bb05-6757b614f835 req-1b364f81-75f5-4a98-9cbd-e5166831e60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9254cf15-b0da-432c-81a4-a9b981a7eda1", "name": "network-vif-deleted", "tag": "f1aef139-585a-4874-a8d4-8cf0c15bf33e"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:25.048967 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-83dd8741-b349-480b-bb05-6757b614f835 req-1b364f81-75f5-4a98-9cbd-e5166831e60d service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:25.049444 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-83dd8741-b349-480b-bb05-6757b614f835 req-1b364f81-75f5-4a98-9cbd-e5166831e60d service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:25.060259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-83dd8741-b349-480b-bb05-6757b614f835 req-1b364f81-75f5-4a98-9cbd-e5166831e60d service nova] Creating event network-vif-deleted:f1aef139-585a-4874-a8d4-8cf0c15bf33e for instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 on hv-cinder-83538 Jul 26 17:19:25.065111 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-83dd8741-b349-480b-bb05-6757b614f835 req-1b364f81-75f5-4a98-9cbd-e5166831e60d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030134 Jul 26 17:19:25.065694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 366/792] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:25.392317 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-35873402-ff3c-47a6-aa39-cc267fef4137 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:25.393609 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-35873402-ff3c-47a6-aa39-cc267fef4137 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:25.402934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35873402-ff3c-47a6-aa39-cc267fef4137 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:25.403708 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35873402-ff3c-47a6-aa39-cc267fef4137 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:25.404512 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35873402-ff3c-47a6-aa39-cc267fef4137 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:25.405528 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35873402-ff3c-47a6-aa39-cc267fef4137 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:25.425916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ed4ad241-c85a-4ad5-b96c-586cfc76c1a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:25.426904 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ed4ad241-c85a-4ad5-b96c-586cfc76c1a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:25.434214 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ed4ad241-c85a-4ad5-b96c-586cfc76c1a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:25.434755 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ed4ad241-c85a-4ad5-b96c-586cfc76c1a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:25.435510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ed4ad241-c85a-4ad5-b96c-586cfc76c1a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:25.435957 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ed4ad241-c85a-4ad5-b96c-586cfc76c1a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:25.506973 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ed4ad241-c85a-4ad5-b96c-586cfc76c1a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97115d07acc5464bb7b097039471fee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b8b6c88af94417c840fdafd1fe431b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:25.515108 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ed4ad241-c85a-4ad5-b96c-586cfc76c1a7 tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 200 len: 1479 microversion: 2.1 time: 0.095565 Jul 26 17:19:25.515683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 367/793] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:25 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 1479 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:19:25.552157 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-35873402-ff3c-47a6-aa39-cc267fef4137 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:25.560610 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-35873402-ff3c-47a6-aa39-cc267fef4137 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1366 microversion: 2.1 time: 0.171368 Jul 26 17:19:25.560610 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 427/794] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:25 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:26.539132 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-74200593-9b60-4ef3-b2c6-efe03da5279e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:26.539821 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-74200593-9b60-4ef3-b2c6-efe03da5279e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] [instance: 9254cf15-b0da-432c-81a4-a9b981a7eda1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:26.548312 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-74200593-9b60-4ef3-b2c6-efe03da5279e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:26.549073 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-74200593-9b60-4ef3-b2c6-efe03da5279e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:26.550049 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-74200593-9b60-4ef3-b2c6-efe03da5279e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:26.550722 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-74200593-9b60-4ef3-b2c6-efe03da5279e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:26.555668 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:26.568018 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-74200593-9b60-4ef3-b2c6-efe03da5279e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] HTTP exception thrown: Instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 could not be found. Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-74200593-9b60-4ef3-b2c6-efe03da5279e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Request method failure captured: Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 HTTP/1.1 Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CC2x0eKkH9UXJgkwe-DjkCoDqloc4SydbPTIUNwkQQ0_-ouZD4LJcioqLwoynbj5fwOQ8ZgXQWu3c-hjOZFFvdgy6I-P1cEeLqhJgW3KkQqc5QCS1kbQ00kpGZ1KpgwuursPfQkB8oQIc4wtw4pQzOfyKY8lCWGfdT8KOsp-1vwtAw Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 2b8b6c88af94417c840fdafd1fe431b7 Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:19:26.569720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:19:26.572554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b8b6c88af94417c840fdafd1fe431b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:19:26.572554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:19:26.572554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 2b8b6c88af94417c840fdafd1fe431b7 Jul 26 17:19:26.572554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-894760419 Jul 26 17:19:26.572554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-ServerRescueNegativeTestJSON-894760419-project Jul 26 17:19:26.572554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:19:26.572554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:19:26.572554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: 97115d07acc5464bb7b097039471fee6 Jul 26 17:19:26.572554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-ServerRescueNegativeTestJSON-894760419-project Jul 26 17:19:26.572554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:19:26.572554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 could not be found. Jul 26 17:19:26.572554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '9254cf15-b0da-432c-81a4-a9b981a7eda1'} Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 could not be found. Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:19:26.578737 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 could not be found. Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 could not be found. Jul 26 17:19:26.582671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:19:26.585723 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-74200593-9b60-4ef3-b2c6-efe03da5279e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] Returning 404 to user: Instance 9254cf15-b0da-432c-81a4-a9b981a7eda1 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:19:26.585723 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-74200593-9b60-4ef3-b2c6-efe03da5279e tempest-ServerRescueNegativeTestJSON-894760419 tempest-ServerRescueNegativeTestJSON-894760419-project] 10.222.0.48 "GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1" status: 404 len: 111 microversion: 2.1 time: 0.037555 Jul 26 17:19:26.585723 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 368/795] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:26 2022] GET /compute/v2.1/servers/9254cf15-b0da-432c-81a4-a9b981a7eda1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 17:19:26.591439 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-979ee2af-ffa4-4f37-9f6c-3ede9e5ca0f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:26.593533 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-979ee2af-ffa4-4f37-9f6c-3ede9e5ca0f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:26.614526 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-979ee2af-ffa4-4f37-9f6c-3ede9e5ca0f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:26.615314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-979ee2af-ffa4-4f37-9f6c-3ede9e5ca0f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:26.616579 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-979ee2af-ffa4-4f37-9f6c-3ede9e5ca0f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:26.617367 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-979ee2af-ffa4-4f37-9f6c-3ede9e5ca0f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:26.761604 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-979ee2af-ffa4-4f37-9f6c-3ede9e5ca0f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:26.769169 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-979ee2af-ffa4-4f37-9f6c-3ede9e5ca0f0 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1366 microversion: 2.1 time: 0.193045 Jul 26 17:19:26.769718 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 428/796] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:26 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:19:27.794187 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a7fdaa27-dc72-4555-a123-afcdd4b0ce55 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:27.795319 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a7fdaa27-dc72-4555-a123-afcdd4b0ce55 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:27.802126 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:27.803188 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=10 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:27.812129 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7fdaa27-dc72-4555-a123-afcdd4b0ce55 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:27.812826 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7fdaa27-dc72-4555-a123-afcdd4b0ce55 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:27.813769 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7fdaa27-dc72-4555-a123-afcdd4b0ce55 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:27.814309 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7fdaa27-dc72-4555-a123-afcdd4b0ce55 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:27.977568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a7fdaa27-dc72-4555-a123-afcdd4b0ce55 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:27.989341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a7fdaa27-dc72-4555-a123-afcdd4b0ce55 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1366 microversion: 2.1 time: 0.201787 Jul 26 17:19:27.990491 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 369/797] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:27 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:29.013184 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-92b0fd95-5132-45b5-ae45-bca5410aa426 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:29.013818 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-92b0fd95-5132-45b5-ae45-bca5410aa426 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:29.015691 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:29.022090 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92b0fd95-5132-45b5-ae45-bca5410aa426 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:29.022549 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92b0fd95-5132-45b5-ae45-bca5410aa426 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:29.023326 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92b0fd95-5132-45b5-ae45-bca5410aa426 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:29.023764 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92b0fd95-5132-45b5-ae45-bca5410aa426 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:29.293947 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-92b0fd95-5132-45b5-ae45-bca5410aa426 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:29.301922 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-92b0fd95-5132-45b5-ae45-bca5410aa426 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1366 microversion: 2.1 time: 0.293895 Jul 26 17:19:29.302508 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 429/798] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:29 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:29.472507 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-17dc7564-51a6-4b67-865b-cc6b32eee283 req-1e7c8a7d-d8f8-4e2b-9087-c321e2ebfd80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a382f9-1c88-4f2c-8692-d03bd154459b", "name": "network-vif-plugged", "status": "completed", "tag": "774e109c-da42-4dc8-9225-464228f56582"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:29.482661 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-17dc7564-51a6-4b67-865b-cc6b32eee283 req-1e7c8a7d-d8f8-4e2b-9087-c321e2ebfd80 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:29.483479 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-17dc7564-51a6-4b67-865b-cc6b32eee283 req-1e7c8a7d-d8f8-4e2b-9087-c321e2ebfd80 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:29.494819 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-17dc7564-51a6-4b67-865b-cc6b32eee283 req-1e7c8a7d-d8f8-4e2b-9087-c321e2ebfd80 service nova] Creating event network-vif-plugged:774e109c-da42-4dc8-9225-464228f56582 for instance f8a382f9-1c88-4f2c-8692-d03bd154459b on hv-cinder-83538 Jul 26 17:19:29.500927 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-17dc7564-51a6-4b67-865b-cc6b32eee283 req-1e7c8a7d-d8f8-4e2b-9087-c321e2ebfd80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032501 Jul 26 17:19:29.501559 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 370/799] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:29.778686 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-56e71c81-f563-4744-894a-2f7575ef67dc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:29.779578 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-56e71c81-f563-4744-894a-2f7575ef67dc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:29.785770 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56e71c81-f563-4744-894a-2f7575ef67dc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:29.786315 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56e71c81-f563-4744-894a-2f7575ef67dc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:29.787369 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56e71c81-f563-4744-894a-2f7575ef67dc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:29.787940 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56e71c81-f563-4744-894a-2f7575ef67dc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:29.820509 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-56e71c81-f563-4744-894a-2f7575ef67dc tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/ips" status: 200 len: 152 microversion: 2.20 time: 0.043214 Jul 26 17:19:29.823928 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 430/800] 10.222.0.48 () {60 vars in 1289 bytes} [Tue Jul 26 17:19:29 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/ips => generated 152 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:19:30.323708 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8233318f-ce67-4073-93f5-b112ee2ff123 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:30.326125 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8233318f-ce67-4073-93f5-b112ee2ff123 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:30.337342 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8233318f-ce67-4073-93f5-b112ee2ff123 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:30.338346 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8233318f-ce67-4073-93f5-b112ee2ff123 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:30.339868 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8233318f-ce67-4073-93f5-b112ee2ff123 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:30.341448 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8233318f-ce67-4073-93f5-b112ee2ff123 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:30.509631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8233318f-ce67-4073-93f5-b112ee2ff123 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:30.518046 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8233318f-ce67-4073-93f5-b112ee2ff123 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1366 microversion: 2.1 time: 0.198787 Jul 26 17:19:30.518727 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 371/801] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:30 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:31.547930 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cd4097b4-10ac-4f93-b279-4ea26ce1d8cd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:31.548660 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cd4097b4-10ac-4f93-b279-4ea26ce1d8cd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:31.561014 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd4097b4-10ac-4f93-b279-4ea26ce1d8cd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:31.561575 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd4097b4-10ac-4f93-b279-4ea26ce1d8cd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:31.562428 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd4097b4-10ac-4f93-b279-4ea26ce1d8cd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:31.562953 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd4097b4-10ac-4f93-b279-4ea26ce1d8cd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:31.714355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cd4097b4-10ac-4f93-b279-4ea26ce1d8cd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:31.723865 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cd4097b4-10ac-4f93-b279-4ea26ce1d8cd tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1366 microversion: 2.1 time: 0.182262 Jul 26 17:19:31.725342 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 431/802] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:31 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:31.783778 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4c2999b0-1a7c-4095-9c9a-622c033f2e7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:31.784338 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4c2999b0-1a7c-4095-9c9a-622c033f2e7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:31.790956 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4c2999b0-1a7c-4095-9c9a-622c033f2e7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:31.791413 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4c2999b0-1a7c-4095-9c9a-622c033f2e7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:31.793036 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4c2999b0-1a7c-4095-9c9a-622c033f2e7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:31.793601 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4c2999b0-1a7c-4095-9c9a-622c033f2e7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:31.817849 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.objects.instance [None req-4c2999b0-1a7c-4095-9c9a-622c033f2e7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lazy-loading 'flavor' on Instance uuid 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 {{(pid=118122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:19:32.047590 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4c2999b0-1a7c-4095-9c9a-622c033f2e7f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "POST /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/action" status: 202 len: 0 microversion: 2.20 time: 0.267624 Jul 26 17:19:32.048193 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 372/803] 10.222.0.48 () {62 vars in 1319 bytes} [Tue Jul 26 17:19:31 2022] POST /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 17:19:32.063470 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be69d762-192e-40dc-a174-2a55a35758d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:32.064415 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be69d762-192e-40dc-a174-2a55a35758d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:32.077299 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be69d762-192e-40dc-a174-2a55a35758d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:32.078441 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be69d762-192e-40dc-a174-2a55a35758d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:32.079994 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be69d762-192e-40dc-a174-2a55a35758d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:32.080718 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be69d762-192e-40dc-a174-2a55a35758d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:32.264126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be69d762-192e-40dc-a174-2a55a35758d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:32.275847 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be69d762-192e-40dc-a174-2a55a35758d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:32.278670 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be69d762-192e-40dc-a174-2a55a35758d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:32.281923 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be69d762-192e-40dc-a174-2a55a35758d1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.228909 Jul 26 17:19:32.282501 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 432/804] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:32 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:19:32.748611 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-746a1a4b-613b-4ea5-aec0-b5eadab10cc3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:32.749529 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-746a1a4b-613b-4ea5-aec0-b5eadab10cc3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:32.757211 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-746a1a4b-613b-4ea5-aec0-b5eadab10cc3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:32.757659 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-746a1a4b-613b-4ea5-aec0-b5eadab10cc3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:32.758703 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-746a1a4b-613b-4ea5-aec0-b5eadab10cc3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:32.759305 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-746a1a4b-613b-4ea5-aec0-b5eadab10cc3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:32.940040 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-746a1a4b-613b-4ea5-aec0-b5eadab10cc3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:32.948731 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-746a1a4b-613b-4ea5-aec0-b5eadab10cc3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1555 microversion: 2.1 time: 0.203790 Jul 26 17:19:32.949462 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 373/805] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:19:32 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:19:32.972481 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-53b11926-4abe-4363-87d7-cc925453856a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:32.973244 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-53b11926-4abe-4363-87d7-cc925453856a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:32.980297 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53b11926-4abe-4363-87d7-cc925453856a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:32.980747 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53b11926-4abe-4363-87d7-cc925453856a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:32.981554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53b11926-4abe-4363-87d7-cc925453856a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:32.982024 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53b11926-4abe-4363-87d7-cc925453856a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:33.086696 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-53b11926-4abe-4363-87d7-cc925453856a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118999 Jul 26 17:19:33.092312 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 433/806] 10.222.0.48 () {58 vars in 1275 bytes} [Tue Jul 26 17:19:32 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:33.307022 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-54e21c16-fd5c-4069-85bc-92a8246b6078 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:33.308196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-54e21c16-fd5c-4069-85bc-92a8246b6078 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:33.315293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-54e21c16-fd5c-4069-85bc-92a8246b6078 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:33.315753 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-54e21c16-fd5c-4069-85bc-92a8246b6078 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:33.316549 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-54e21c16-fd5c-4069-85bc-92a8246b6078 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:33.317034 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-54e21c16-fd5c-4069-85bc-92a8246b6078 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:33.606503 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-54e21c16-fd5c-4069-85bc-92a8246b6078 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:33.618108 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-54e21c16-fd5c-4069-85bc-92a8246b6078 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:33.620791 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-54e21c16-fd5c-4069-85bc-92a8246b6078 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:33.622243 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-54e21c16-fd5c-4069-85bc-92a8246b6078 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.319378 Jul 26 17:19:33.623125 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 374/807] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:33 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:34.531699 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-76807d4c-a30e-4489-b739-311bb8b04b5f req-1082669d-d679-4296-aa02-234a42532bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a382f9-1c88-4f2c-8692-d03bd154459b", "tag": "774e109c-da42-4dc8-9225-464228f56582"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:34.541254 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-76807d4c-a30e-4489-b739-311bb8b04b5f req-1082669d-d679-4296-aa02-234a42532bb1 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:34.541824 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-76807d4c-a30e-4489-b739-311bb8b04b5f req-1082669d-d679-4296-aa02-234a42532bb1 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:34.557468 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-76807d4c-a30e-4489-b739-311bb8b04b5f req-1082669d-d679-4296-aa02-234a42532bb1 service nova] Creating event network-changed:774e109c-da42-4dc8-9225-464228f56582 for instance f8a382f9-1c88-4f2c-8692-d03bd154459b on hv-cinder-83538 Jul 26 17:19:34.569016 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-76807d4c-a30e-4489-b739-311bb8b04b5f req-1082669d-d679-4296-aa02-234a42532bb1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039036 Jul 26 17:19:34.570093 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 434/808] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:34.649444 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8e9ff801-afbd-41d0-92e5-671e6c9a0d04 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:34.650855 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8e9ff801-afbd-41d0-92e5-671e6c9a0d04 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:34.661967 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8e9ff801-afbd-41d0-92e5-671e6c9a0d04 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:34.662774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8e9ff801-afbd-41d0-92e5-671e6c9a0d04 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:34.663878 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8e9ff801-afbd-41d0-92e5-671e6c9a0d04 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:34.664526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8e9ff801-afbd-41d0-92e5-671e6c9a0d04 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:34.852575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8e9ff801-afbd-41d0-92e5-671e6c9a0d04 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:34.863141 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8e9ff801-afbd-41d0-92e5-671e6c9a0d04 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:34.864996 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8e9ff801-afbd-41d0-92e5-671e6c9a0d04 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:34.866385 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8e9ff801-afbd-41d0-92e5-671e6c9a0d04 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.222993 Jul 26 17:19:34.867591 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 375/809] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:34 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:35.891667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f4055f70-2c5b-49d4-973f-97bde3c85d08 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:35.892368 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f4055f70-2c5b-49d4-973f-97bde3c85d08 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:35.899222 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4055f70-2c5b-49d4-973f-97bde3c85d08 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:35.899673 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4055f70-2c5b-49d4-973f-97bde3c85d08 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:35.900444 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4055f70-2c5b-49d4-973f-97bde3c85d08 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:35.900945 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4055f70-2c5b-49d4-973f-97bde3c85d08 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:36.046201 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f4055f70-2c5b-49d4-973f-97bde3c85d08 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:36.054835 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f4055f70-2c5b-49d4-973f-97bde3c85d08 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:36.056490 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f4055f70-2c5b-49d4-973f-97bde3c85d08 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:36.058374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f4055f70-2c5b-49d4-973f-97bde3c85d08 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.170947 Jul 26 17:19:36.058937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 435/810] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:35 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:19:37.081435 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d4423203-ea0c-4c2d-87d7-506857deb069 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:37.082085 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d4423203-ea0c-4c2d-87d7-506857deb069 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:37.089236 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d4423203-ea0c-4c2d-87d7-506857deb069 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:37.089688 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d4423203-ea0c-4c2d-87d7-506857deb069 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:37.090459 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d4423203-ea0c-4c2d-87d7-506857deb069 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:37.090895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d4423203-ea0c-4c2d-87d7-506857deb069 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:37.239842 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d4423203-ea0c-4c2d-87d7-506857deb069 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:37.248457 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d4423203-ea0c-4c2d-87d7-506857deb069 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:37.250265 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d4423203-ea0c-4c2d-87d7-506857deb069 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:37.251456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d4423203-ea0c-4c2d-87d7-506857deb069 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.174006 Jul 26 17:19:37.252095 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 376/811] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:37 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:38.279200 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5dee3465-3d7f-4c15-bda5-b4d66f4793a5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:38.280322 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5dee3465-3d7f-4c15-bda5-b4d66f4793a5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:38.288356 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5dee3465-3d7f-4c15-bda5-b4d66f4793a5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:38.289214 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5dee3465-3d7f-4c15-bda5-b4d66f4793a5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:38.290082 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5dee3465-3d7f-4c15-bda5-b4d66f4793a5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:38.290522 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5dee3465-3d7f-4c15-bda5-b4d66f4793a5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:38.474479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5dee3465-3d7f-4c15-bda5-b4d66f4793a5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:38.483333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5dee3465-3d7f-4c15-bda5-b4d66f4793a5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:38.484874 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5dee3465-3d7f-4c15-bda5-b4d66f4793a5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:38.486170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5dee3465-3d7f-4c15-bda5-b4d66f4793a5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.214804 Jul 26 17:19:38.486721 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 436/812] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:38 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:39.509634 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-06e2ce00-9ae7-4d2d-bcd1-a4a9f10544ab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:39.510982 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-06e2ce00-9ae7-4d2d-bcd1-a4a9f10544ab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:39.517271 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-06e2ce00-9ae7-4d2d-bcd1-a4a9f10544ab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:39.517878 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-06e2ce00-9ae7-4d2d-bcd1-a4a9f10544ab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:39.518591 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-06e2ce00-9ae7-4d2d-bcd1-a4a9f10544ab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:39.518901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-06e2ce00-9ae7-4d2d-bcd1-a4a9f10544ab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:39.661664 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-06e2ce00-9ae7-4d2d-bcd1-a4a9f10544ab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:39.670551 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-06e2ce00-9ae7-4d2d-bcd1-a4a9f10544ab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:39.672160 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-06e2ce00-9ae7-4d2d-bcd1-a4a9f10544ab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:39.673264 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-06e2ce00-9ae7-4d2d-bcd1-a4a9f10544ab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.167630 Jul 26 17:19:39.673809 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 377/813] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:39 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:19:40.696424 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-22e14a2b-70ce-42a3-95bf-fae2cd7e0f9b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:40.697102 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-22e14a2b-70ce-42a3-95bf-fae2cd7e0f9b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:40.704396 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22e14a2b-70ce-42a3-95bf-fae2cd7e0f9b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:40.704842 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22e14a2b-70ce-42a3-95bf-fae2cd7e0f9b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:40.705629 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22e14a2b-70ce-42a3-95bf-fae2cd7e0f9b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:40.706053 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22e14a2b-70ce-42a3-95bf-fae2cd7e0f9b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:40.837000 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22e14a2b-70ce-42a3-95bf-fae2cd7e0f9b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:40.845316 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22e14a2b-70ce-42a3-95bf-fae2cd7e0f9b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:40.846814 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22e14a2b-70ce-42a3-95bf-fae2cd7e0f9b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:40.847965 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-22e14a2b-70ce-42a3-95bf-fae2cd7e0f9b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.155416 Jul 26 17:19:40.848515 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 437/814] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:40 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:41.872228 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4f05fc8f-39e9-4381-9a49-5841af0b9054 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:41.872832 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4f05fc8f-39e9-4381-9a49-5841af0b9054 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:41.880052 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f05fc8f-39e9-4381-9a49-5841af0b9054 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:41.880595 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f05fc8f-39e9-4381-9a49-5841af0b9054 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:41.881391 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f05fc8f-39e9-4381-9a49-5841af0b9054 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:41.881827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f05fc8f-39e9-4381-9a49-5841af0b9054 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:42.010996 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4f05fc8f-39e9-4381-9a49-5841af0b9054 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:42.018975 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4f05fc8f-39e9-4381-9a49-5841af0b9054 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:42.020462 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4f05fc8f-39e9-4381-9a49-5841af0b9054 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:42.021642 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4f05fc8f-39e9-4381-9a49-5841af0b9054 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.154182 Jul 26 17:19:42.022185 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 378/815] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:41 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:43.046127 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-602b67b1-1eeb-49c5-b514-64583c408bf1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:43.046767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-602b67b1-1eeb-49c5-b514-64583c408bf1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:43.053242 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-602b67b1-1eeb-49c5-b514-64583c408bf1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:43.053685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-602b67b1-1eeb-49c5-b514-64583c408bf1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:43.054447 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-602b67b1-1eeb-49c5-b514-64583c408bf1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:43.054882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-602b67b1-1eeb-49c5-b514-64583c408bf1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:43.185657 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-602b67b1-1eeb-49c5-b514-64583c408bf1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:43.193705 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-602b67b1-1eeb-49c5-b514-64583c408bf1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:43.195276 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-602b67b1-1eeb-49c5-b514-64583c408bf1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:43.196477 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-602b67b1-1eeb-49c5-b514-64583c408bf1 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.154924 Jul 26 17:19:43.197063 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 438/816] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:43 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:43.466160 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6c4d8bd4-d678-4bfe-b419-f6ad28eb431c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:43.466777 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6c4d8bd4-d678-4bfe-b419-f6ad28eb431c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:43.473398 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6c4d8bd4-d678-4bfe-b419-f6ad28eb431c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:43.473854 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6c4d8bd4-d678-4bfe-b419-f6ad28eb431c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:43.474630 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6c4d8bd4-d678-4bfe-b419-f6ad28eb431c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:43.475071 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6c4d8bd4-d678-4bfe-b419-f6ad28eb431c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:43.498776 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6c4d8bd4-d678-4bfe-b419-f6ad28eb431c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/ips" status: 200 len: 144 microversion: 2.1 time: 0.037167 Jul 26 17:19:43.499375 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 379/817] 10.222.0.48 () {58 vars in 1248 bytes} [Tue Jul 26 17:19:43 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:44.220664 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b61ff891-96b1-4d87-ba22-555632386c22 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:44.221439 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b61ff891-96b1-4d87-ba22-555632386c22 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:44.228917 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b61ff891-96b1-4d87-ba22-555632386c22 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:44.229410 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b61ff891-96b1-4d87-ba22-555632386c22 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:44.230424 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b61ff891-96b1-4d87-ba22-555632386c22 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:44.230989 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b61ff891-96b1-4d87-ba22-555632386c22 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:44.376776 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b61ff891-96b1-4d87-ba22-555632386c22 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:44.385803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b61ff891-96b1-4d87-ba22-555632386c22 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:44.387888 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b61ff891-96b1-4d87-ba22-555632386c22 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:44.389099 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b61ff891-96b1-4d87-ba22-555632386c22 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.172526 Jul 26 17:19:44.395786 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 439/818] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:44 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:44.839611 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0424d6ee-7f0e-4909-ba32-1f5f0f41b7b8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec178f7e-225d-4445-afb1-d1496d8f475d"}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:44.842154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0424d6ee-7f0e-4909-ba32-1f5f0f41b7b8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:44.848871 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0424d6ee-7f0e-4909-ba32-1f5f0f41b7b8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:44.849358 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0424d6ee-7f0e-4909-ba32-1f5f0f41b7b8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:44.850143 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0424d6ee-7f0e-4909-ba32-1f5f0f41b7b8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:44.850582 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0424d6ee-7f0e-4909-ba32-1f5f0f41b7b8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:45.138559 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0424d6ee-7f0e-4909-ba32-1f5f0f41b7b8 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "POST /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302876 Jul 26 17:19:45.139504 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 380/819] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:19:44 2022] POST /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:45.412037 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4201dfa8-c2a2-4251-9fcd-5e83296bb0ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:45.412774 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4201dfa8-c2a2-4251-9fcd-5e83296bb0ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:45.421256 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4201dfa8-c2a2-4251-9fcd-5e83296bb0ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:45.421715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4201dfa8-c2a2-4251-9fcd-5e83296bb0ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:45.422508 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4201dfa8-c2a2-4251-9fcd-5e83296bb0ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:45.422947 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4201dfa8-c2a2-4251-9fcd-5e83296bb0ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:45.584326 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4201dfa8-c2a2-4251-9fcd-5e83296bb0ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:45.593835 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4201dfa8-c2a2-4251-9fcd-5e83296bb0ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:45.595838 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4201dfa8-c2a2-4251-9fcd-5e83296bb0ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:45.597056 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4201dfa8-c2a2-4251-9fcd-5e83296bb0ee tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.188921 Jul 26 17:19:45.597629 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 440/820] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:45 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:46.622075 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1bfc26c1-e80a-451c-959a-24cc14917b59 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:46.622872 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1bfc26c1-e80a-451c-959a-24cc14917b59 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:46.633765 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bfc26c1-e80a-451c-959a-24cc14917b59 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:46.634587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bfc26c1-e80a-451c-959a-24cc14917b59 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:46.636693 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bfc26c1-e80a-451c-959a-24cc14917b59 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:46.637544 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bfc26c1-e80a-451c-959a-24cc14917b59 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:46.791911 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1bfc26c1-e80a-451c-959a-24cc14917b59 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:46.801280 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1bfc26c1-e80a-451c-959a-24cc14917b59 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:46.803256 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1bfc26c1-e80a-451c-959a-24cc14917b59 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:46.804441 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1bfc26c1-e80a-451c-959a-24cc14917b59 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.188195 Jul 26 17:19:46.805023 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 381/821] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:46 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:47.828562 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a294ea09-87e7-4edf-a4ad-5ada6f7c12d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:47.829186 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a294ea09-87e7-4edf-a4ad-5ada6f7c12d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:47.836616 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a294ea09-87e7-4edf-a4ad-5ada6f7c12d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:47.837224 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a294ea09-87e7-4edf-a4ad-5ada6f7c12d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:47.838064 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a294ea09-87e7-4edf-a4ad-5ada6f7c12d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:47.838540 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a294ea09-87e7-4edf-a4ad-5ada6f7c12d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:47.974288 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a294ea09-87e7-4edf-a4ad-5ada6f7c12d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:47.983439 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a294ea09-87e7-4edf-a4ad-5ada6f7c12d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:47.984974 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a294ea09-87e7-4edf-a4ad-5ada6f7c12d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:47.986170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a294ea09-87e7-4edf-a4ad-5ada6f7c12d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1746 microversion: 2.20 time: 0.161474 Jul 26 17:19:47.986730 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 441/822] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:47 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:49.009970 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-39173ebc-fc7c-405b-bdbe-fe88d37cf154 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:49.010607 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-39173ebc-fc7c-405b-bdbe-fe88d37cf154 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:49.017596 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-39173ebc-fc7c-405b-bdbe-fe88d37cf154 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:49.018050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-39173ebc-fc7c-405b-bdbe-fe88d37cf154 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:49.018837 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-39173ebc-fc7c-405b-bdbe-fe88d37cf154 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:49.019284 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-39173ebc-fc7c-405b-bdbe-fe88d37cf154 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:49.184796 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-39173ebc-fc7c-405b-bdbe-fe88d37cf154 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:49.193523 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-39173ebc-fc7c-405b-bdbe-fe88d37cf154 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:49.195012 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-39173ebc-fc7c-405b-bdbe-fe88d37cf154 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:49.196179 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-39173ebc-fc7c-405b-bdbe-fe88d37cf154 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1746 microversion: 2.20 time: 0.190356 Jul 26 17:19:49.196727 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 382/823] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:49 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1746 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:50.220887 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a34d0291-6f04-42d4-b0da-00b441a91e38 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:50.221599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a34d0291-6f04-42d4-b0da-00b441a91e38 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:50.228816 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a34d0291-6f04-42d4-b0da-00b441a91e38 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:50.229548 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a34d0291-6f04-42d4-b0da-00b441a91e38 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:50.230703 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a34d0291-6f04-42d4-b0da-00b441a91e38 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:50.231282 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a34d0291-6f04-42d4-b0da-00b441a91e38 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:50.386763 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a34d0291-6f04-42d4-b0da-00b441a91e38 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:50.396442 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a34d0291-6f04-42d4-b0da-00b441a91e38 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:50.397974 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a34d0291-6f04-42d4-b0da-00b441a91e38 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:50.399486 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a34d0291-6f04-42d4-b0da-00b441a91e38 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1741 microversion: 2.20 time: 0.183155 Jul 26 17:19:50.417502 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 442/824] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:50 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:51.435678 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-10515a6c-756b-4b9a-8f75-4f42f181b345 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:51.436456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-10515a6c-756b-4b9a-8f75-4f42f181b345 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:51.442879 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=48 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:51.445196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-10515a6c-756b-4b9a-8f75-4f42f181b345 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:51.445980 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-10515a6c-756b-4b9a-8f75-4f42f181b345 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:51.448295 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-10515a6c-756b-4b9a-8f75-4f42f181b345 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:51.449621 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-10515a6c-756b-4b9a-8f75-4f42f181b345 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:51.455829 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:51.711085 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-10515a6c-756b-4b9a-8f75-4f42f181b345 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:51.724230 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-10515a6c-756b-4b9a-8f75-4f42f181b345 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:51.734346 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-10515a6c-756b-4b9a-8f75-4f42f181b345 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:51.736523 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-10515a6c-756b-4b9a-8f75-4f42f181b345 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1741 microversion: 2.20 time: 0.304683 Jul 26 17:19:51.737346 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 383/825] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:51 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1741 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:51.765666 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-0a947444-69a1-485f-b338-4846bce86572 req-e5779ff6-1782-47fd-a37e-ad6d2a7b371a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a85ce7-0ab6-4543-a87c-8231bde9c4b5", "name": "network-vif-plugged", "status": "completed", "tag": "76e89343-401e-41b9-8e6d-0ed7a6b1167b"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:51.793626 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-0a947444-69a1-485f-b338-4846bce86572 req-e5779ff6-1782-47fd-a37e-ad6d2a7b371a service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:51.794374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-0a947444-69a1-485f-b338-4846bce86572 req-e5779ff6-1782-47fd-a37e-ad6d2a7b371a service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:51.797793 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:51.811081 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-0a947444-69a1-485f-b338-4846bce86572 req-e5779ff6-1782-47fd-a37e-ad6d2a7b371a service nova] Creating event network-vif-plugged:76e89343-401e-41b9-8e6d-0ed7a6b1167b for instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 on hv-cinder-83538 Jul 26 17:19:51.817263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-0a947444-69a1-485f-b338-4846bce86572 req-e5779ff6-1782-47fd-a37e-ad6d2a7b371a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058788 Jul 26 17:19:51.818448 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 443/826] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:52.764436 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a23b0b61-6155-4e5b-8cb3-587b82e34c71 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:52.765956 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a23b0b61-6155-4e5b-8cb3-587b82e34c71 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:52.773224 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a23b0b61-6155-4e5b-8cb3-587b82e34c71 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:52.773916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a23b0b61-6155-4e5b-8cb3-587b82e34c71 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:52.774875 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a23b0b61-6155-4e5b-8cb3-587b82e34c71 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:52.775467 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a23b0b61-6155-4e5b-8cb3-587b82e34c71 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:52.880182 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b4204eff-c4cc-4424-ae93-bdc896073eb0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:52.887833 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b4204eff-c4cc-4424-ae93-bdc896073eb0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:52.897388 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b4204eff-c4cc-4424-ae93-bdc896073eb0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:52.898277 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b4204eff-c4cc-4424-ae93-bdc896073eb0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:52.899306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b4204eff-c4cc-4424-ae93-bdc896073eb0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:52.899996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b4204eff-c4cc-4424-ae93-bdc896073eb0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:52.944840 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b4204eff-c4cc-4424-ae93-bdc896073eb0 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075400 Jul 26 17:19:52.957381 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 444/827] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:19:52 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:52.966385 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f62b1a23-aa41-4cf0-820e-f656751fcc73 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:52.966888 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f62b1a23-aa41-4cf0-820e-f656751fcc73 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:52.974525 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f62b1a23-aa41-4cf0-820e-f656751fcc73 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:52.974996 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f62b1a23-aa41-4cf0-820e-f656751fcc73 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:52.975787 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f62b1a23-aa41-4cf0-820e-f656751fcc73 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:52.976223 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f62b1a23-aa41-4cf0-820e-f656751fcc73 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:53.018706 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a23b0b61-6155-4e5b-8cb3-587b82e34c71 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:53.033006 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f62b1a23-aa41-4cf0-820e-f656751fcc73 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments/ec178f7e-225d-4445-afb1-d1496d8f475d" status: 200 len: 194 microversion: 2.1 time: 0.070462 Jul 26 17:19:53.039547 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a23b0b61-6155-4e5b-8cb3-587b82e34c71 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:53.046298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a23b0b61-6155-4e5b-8cb3-587b82e34c71 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:53.049850 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a23b0b61-6155-4e5b-8cb3-587b82e34c71 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1741 microversion: 2.20 time: 0.291378 Jul 26 17:19:53.050216 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 445/828] 10.222.0.48 () {58 vars in 1413 bytes} [Tue Jul 26 17:19:52 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments/ec178f7e-225d-4445-afb1-d1496d8f475d => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:53.051837 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 384/829] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:52 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1741 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:54.077570 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-558b34c8-9ee0-4681-aabe-4d15fe5186d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:54.078898 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-558b34c8-9ee0-4681-aabe-4d15fe5186d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:54.086877 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-558b34c8-9ee0-4681-aabe-4d15fe5186d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:54.087997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-558b34c8-9ee0-4681-aabe-4d15fe5186d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:54.089177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-558b34c8-9ee0-4681-aabe-4d15fe5186d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:54.089865 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-558b34c8-9ee0-4681-aabe-4d15fe5186d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:54.329065 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-558b34c8-9ee0-4681-aabe-4d15fe5186d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:54.339304 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-558b34c8-9ee0-4681-aabe-4d15fe5186d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:54.347142 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-558b34c8-9ee0-4681-aabe-4d15fe5186d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:54.354015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-558b34c8-9ee0-4681-aabe-4d15fe5186d5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1741 microversion: 2.20 time: 0.280438 Jul 26 17:19:54.356245 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 446/830] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:54 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1741 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:54.530086 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-fd86329e-1214-4a77-b43f-5d4fd84e179c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5edf39ee-4e1f-4f0a-aa35-05a1083b2286"}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:19:54.535281 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-fd86329e-1214-4a77-b43f-5d4fd84e179c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:54.545144 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd86329e-1214-4a77-b43f-5d4fd84e179c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:54.546081 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd86329e-1214-4a77-b43f-5d4fd84e179c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:54.547805 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd86329e-1214-4a77-b43f-5d4fd84e179c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:54.548434 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd86329e-1214-4a77-b43f-5d4fd84e179c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:54.894873 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-fd86329e-1214-4a77-b43f-5d4fd84e179c tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "POST /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372940 Jul 26 17:19:54.896185 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 385/831] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:19:54 2022] POST /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:19:55.379413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6eeb7e66-4dbb-45e3-904c-b5c0a24cfb95 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:55.380203 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6eeb7e66-4dbb-45e3-904c-b5c0a24cfb95 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:55.383138 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=42 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:19:55.390328 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6eeb7e66-4dbb-45e3-904c-b5c0a24cfb95 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:55.391140 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6eeb7e66-4dbb-45e3-904c-b5c0a24cfb95 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:55.392373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6eeb7e66-4dbb-45e3-904c-b5c0a24cfb95 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:55.393153 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6eeb7e66-4dbb-45e3-904c-b5c0a24cfb95 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:55.591370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6eeb7e66-4dbb-45e3-904c-b5c0a24cfb95 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:55.604778 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6eeb7e66-4dbb-45e3-904c-b5c0a24cfb95 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:55.604778 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6eeb7e66-4dbb-45e3-904c-b5c0a24cfb95 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:55.606543 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6eeb7e66-4dbb-45e3-904c-b5c0a24cfb95 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1741 microversion: 2.20 time: 0.230814 Jul 26 17:19:55.607131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 447/832] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:55 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:56.633797 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-91e7cb23-784b-4a99-98a3-2e156b01fd2f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:56.634544 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-91e7cb23-784b-4a99-98a3-2e156b01fd2f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:56.648481 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-91e7cb23-784b-4a99-98a3-2e156b01fd2f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:56.650250 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-91e7cb23-784b-4a99-98a3-2e156b01fd2f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:56.652849 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-91e7cb23-784b-4a99-98a3-2e156b01fd2f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:56.654224 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-91e7cb23-784b-4a99-98a3-2e156b01fd2f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:56.876950 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-91e7cb23-784b-4a99-98a3-2e156b01fd2f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:56.887815 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-91e7cb23-784b-4a99-98a3-2e156b01fd2f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:56.889545 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-91e7cb23-784b-4a99-98a3-2e156b01fd2f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:56.891786 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-91e7cb23-784b-4a99-98a3-2e156b01fd2f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1741 microversion: 2.20 time: 0.262630 Jul 26 17:19:56.892667 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 386/833] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:56 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1741 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:19:57.921100 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-553da228-b830-4e7a-9ec1-acf3ecc497f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:57.922557 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-553da228-b830-4e7a-9ec1-acf3ecc497f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:57.931649 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-553da228-b830-4e7a-9ec1-acf3ecc497f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:57.932601 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-553da228-b830-4e7a-9ec1-acf3ecc497f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:57.933707 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-553da228-b830-4e7a-9ec1-acf3ecc497f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:57.934292 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-553da228-b830-4e7a-9ec1-acf3ecc497f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:58.145888 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-553da228-b830-4e7a-9ec1-acf3ecc497f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:58.157556 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-553da228-b830-4e7a-9ec1-acf3ecc497f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:58.159164 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-553da228-b830-4e7a-9ec1-acf3ecc497f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:58.160415 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-553da228-b830-4e7a-9ec1-acf3ecc497f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1741 microversion: 2.20 time: 0.246288 Jul 26 17:19:58.161215 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 448/834] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:57 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1741 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:19:59.188442 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d1a7365d-8740-490a-a28c-072cb6fb3a13 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:19:59.189469 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d1a7365d-8740-490a-a28c-072cb6fb3a13 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:19:59.199377 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d1a7365d-8740-490a-a28c-072cb6fb3a13 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:59.199993 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d1a7365d-8740-490a-a28c-072cb6fb3a13 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:59.200811 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d1a7365d-8740-490a-a28c-072cb6fb3a13 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:19:59.201294 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d1a7365d-8740-490a-a28c-072cb6fb3a13 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:19:59.379809 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d1a7365d-8740-490a-a28c-072cb6fb3a13 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:59.389635 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d1a7365d-8740-490a-a28c-072cb6fb3a13 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:59.391189 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-d1a7365d-8740-490a-a28c-072cb6fb3a13 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:19:59.392560 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d1a7365d-8740-490a-a28c-072cb6fb3a13 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1741 microversion: 2.20 time: 0.211721 Jul 26 17:19:59.393162 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 387/835] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:19:59 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:00.418469 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e9139c8e-0739-48dc-aaa0-26f454d66c79 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:00.419078 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e9139c8e-0739-48dc-aaa0-26f454d66c79 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:00.425940 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9139c8e-0739-48dc-aaa0-26f454d66c79 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:00.426396 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9139c8e-0739-48dc-aaa0-26f454d66c79 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:00.427188 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9139c8e-0739-48dc-aaa0-26f454d66c79 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:00.427628 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9139c8e-0739-48dc-aaa0-26f454d66c79 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:00.567544 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e9139c8e-0739-48dc-aaa0-26f454d66c79 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:00.576109 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e9139c8e-0739-48dc-aaa0-26f454d66c79 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:00.577635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e9139c8e-0739-48dc-aaa0-26f454d66c79 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:00.578852 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e9139c8e-0739-48dc-aaa0-26f454d66c79 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1741 microversion: 2.20 time: 0.164355 Jul 26 17:20:00.579456 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 449/836] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:00 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:01.602535 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ee03745e-cbae-4786-a0ae-c2dde5ebadab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:01.603120 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ee03745e-cbae-4786-a0ae-c2dde5ebadab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:01.610953 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ee03745e-cbae-4786-a0ae-c2dde5ebadab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:01.611184 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ee03745e-cbae-4786-a0ae-c2dde5ebadab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:01.612078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ee03745e-cbae-4786-a0ae-c2dde5ebadab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:01.612530 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ee03745e-cbae-4786-a0ae-c2dde5ebadab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:01.755540 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ee03745e-cbae-4786-a0ae-c2dde5ebadab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:01.764360 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ee03745e-cbae-4786-a0ae-c2dde5ebadab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:01.765969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ee03745e-cbae-4786-a0ae-c2dde5ebadab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:01.767133 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ee03745e-cbae-4786-a0ae-c2dde5ebadab tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1723 microversion: 2.20 time: 0.168444 Jul 26 17:20:01.767686 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 388/837] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:01 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:02.794057 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9a596119-6a36-4ee3-a336-3a6fc27a09c6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:02.794680 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9a596119-6a36-4ee3-a336-3a6fc27a09c6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:02.801440 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a596119-6a36-4ee3-a336-3a6fc27a09c6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:02.801896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a596119-6a36-4ee3-a336-3a6fc27a09c6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:02.802679 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a596119-6a36-4ee3-a336-3a6fc27a09c6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:02.803114 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a596119-6a36-4ee3-a336-3a6fc27a09c6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:03.005484 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a596119-6a36-4ee3-a336-3a6fc27a09c6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:03.013921 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a596119-6a36-4ee3-a336-3a6fc27a09c6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:03.015435 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a596119-6a36-4ee3-a336-3a6fc27a09c6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:03.016603 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9a596119-6a36-4ee3-a336-3a6fc27a09c6 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1723 microversion: 2.20 time: 0.226688 Jul 26 17:20:03.017194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 450/838] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:02 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:03.683947 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-3ee45ed6-7017-47c7-9c13-88b62c504d1a req-53079a8a-ceb4-4bb3-bf7a-6b14d8f43a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a85ce7-0ab6-4543-a87c-8231bde9c4b5", "name": "network-vif-unplugged", "status": "completed", "tag": "76e89343-401e-41b9-8e6d-0ed7a6b1167b"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:03.692097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-787e52df-62e8-44fc-8c29-c5340391afbd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:03.694390 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-787e52df-62e8-44fc-8c29-c5340391afbd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:03.699915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-3ee45ed6-7017-47c7-9c13-88b62c504d1a req-53079a8a-ceb4-4bb3-bf7a-6b14d8f43a0b service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:03.700359 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-3ee45ed6-7017-47c7-9c13-88b62c504d1a req-53079a8a-ceb4-4bb3-bf7a-6b14d8f43a0b service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:03.701068 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-787e52df-62e8-44fc-8c29-c5340391afbd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:03.701585 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-787e52df-62e8-44fc-8c29-c5340391afbd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:03.702387 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-787e52df-62e8-44fc-8c29-c5340391afbd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:03.702802 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-787e52df-62e8-44fc-8c29-c5340391afbd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:03.717274 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-3ee45ed6-7017-47c7-9c13-88b62c504d1a req-53079a8a-ceb4-4bb3-bf7a-6b14d8f43a0b service nova] Creating event network-vif-unplugged:76e89343-401e-41b9-8e6d-0ed7a6b1167b for instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 on hv-cinder-83538 Jul 26 17:20:03.723971 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-3ee45ed6-7017-47c7-9c13-88b62c504d1a req-53079a8a-ceb4-4bb3-bf7a-6b14d8f43a0b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045514 Jul 26 17:20:03.725523 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 389/839] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:20:03.736421 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-787e52df-62e8-44fc-8c29-c5340391afbd tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050525 Jul 26 17:20:03.737011 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 451/840] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:20:03 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:20:03.895664 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c6935556-3f18-4e90-a88b-1fbdf05804d5 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:03.896149 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c6935556-3f18-4e90-a88b-1fbdf05804d5 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:03.903555 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c6935556-3f18-4e90-a88b-1fbdf05804d5 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:03.903995 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c6935556-3f18-4e90-a88b-1fbdf05804d5 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:03.904760 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c6935556-3f18-4e90-a88b-1fbdf05804d5 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:03.905214 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c6935556-3f18-4e90-a88b-1fbdf05804d5 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:03.938652 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c6935556-3f18-4e90-a88b-1fbdf05804d5 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments/ec178f7e-225d-4445-afb1-d1496d8f475d" status: 200 len: 194 microversion: 2.1 time: 0.048336 Jul 26 17:20:03.939304 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 390/841] 10.222.0.48 () {58 vars in 1413 bytes} [Tue Jul 26 17:20:03 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments/ec178f7e-225d-4445-afb1-d1496d8f475d => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:20:03.950730 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-de61af8e-9145-4d58-8ad2-8bde8c29282d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:03.951307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-de61af8e-9145-4d58-8ad2-8bde8c29282d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:03.958094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-de61af8e-9145-4d58-8ad2-8bde8c29282d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:03.958365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-de61af8e-9145-4d58-8ad2-8bde8c29282d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:03.959138 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-de61af8e-9145-4d58-8ad2-8bde8c29282d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:03.959637 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-de61af8e-9145-4d58-8ad2-8bde8c29282d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:04.040762 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0c80d918-d46c-436d-b070-825edad40010 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:04.042057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0c80d918-d46c-436d-b070-825edad40010 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:04.048416 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0c80d918-d46c-436d-b070-825edad40010 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:04.048870 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0c80d918-d46c-436d-b070-825edad40010 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:04.049905 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0c80d918-d46c-436d-b070-825edad40010 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:04.050345 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0c80d918-d46c-436d-b070-825edad40010 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:04.058536 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-de61af8e-9145-4d58-8ad2-8bde8c29282d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lazy-loading 'services' on Instance uuid 0bd0d4f3-4697-482a-a601-7bb08472adfc {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:20:04.149461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-de61af8e-9145-4d58-8ad2-8bde8c29282d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments/ec178f7e-225d-4445-afb1-d1496d8f475d" status: 202 len: 0 microversion: 2.1 time: 0.202787 Jul 26 17:20:04.149995 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 452/842] 10.222.0.48 () {58 vars in 1416 bytes} [Tue Jul 26 17:20:03 2022] DELETE /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments/ec178f7e-225d-4445-afb1-d1496d8f475d => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:20:04.221208 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0c80d918-d46c-436d-b070-825edad40010 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:04.230514 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0c80d918-d46c-436d-b070-825edad40010 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:04.232016 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0c80d918-d46c-436d-b070-825edad40010 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:04.233214 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0c80d918-d46c-436d-b070-825edad40010 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1723 microversion: 2.20 time: 0.197159 Jul 26 17:20:04.233762 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 391/843] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:04 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:20:05.263712 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b0cf8e54-4e4e-43c9-bd67-f54092af1c5a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:05.264507 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b0cf8e54-4e4e-43c9-bd67-f54092af1c5a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:05.270905 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0cf8e54-4e4e-43c9-bd67-f54092af1c5a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:05.271353 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0cf8e54-4e4e-43c9-bd67-f54092af1c5a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:05.272135 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0cf8e54-4e4e-43c9-bd67-f54092af1c5a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:05.272572 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0cf8e54-4e4e-43c9-bd67-f54092af1c5a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:05.708258 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b0cf8e54-4e4e-43c9-bd67-f54092af1c5a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:05.723304 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b0cf8e54-4e4e-43c9-bd67-f54092af1c5a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:05.727681 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b0cf8e54-4e4e-43c9-bd67-f54092af1c5a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:05.727681 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b0cf8e54-4e4e-43c9-bd67-f54092af1c5a tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1726 microversion: 2.20 time: 0.471231 Jul 26 17:20:05.727681 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 453/844] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:05 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1726 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:05.760387 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-290a9ff8-af7b-4f3f-a458-47998776bd54 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a64efda2-7f86-4da4-b332-6cab266a6f6a"}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:05.763059 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-290a9ff8-af7b-4f3f-a458-47998776bd54 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:05.770881 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-290a9ff8-af7b-4f3f-a458-47998776bd54 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:05.771419 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-290a9ff8-af7b-4f3f-a458-47998776bd54 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:05.772210 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-290a9ff8-af7b-4f3f-a458-47998776bd54 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:05.772683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-290a9ff8-af7b-4f3f-a458-47998776bd54 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:06.214554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-290a9ff8-af7b-4f3f-a458-47998776bd54 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "POST /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.458295 Jul 26 17:20:06.216082 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 392/845] 10.222.0.48 () {62 vars in 1364 bytes} [Tue Jul 26 17:20:05 2022] POST /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/os-volume_attachments => generated 188 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 17:20:06.463437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3c7e7c5f-7e10-449b-89e4-5394f54e36f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:06.464183 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3c7e7c5f-7e10-449b-89e4-5394f54e36f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:06.471723 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c7e7c5f-7e10-449b-89e4-5394f54e36f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:06.472498 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c7e7c5f-7e10-449b-89e4-5394f54e36f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:06.473622 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c7e7c5f-7e10-449b-89e4-5394f54e36f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:06.474248 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c7e7c5f-7e10-449b-89e4-5394f54e36f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:06.813140 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3c7e7c5f-7e10-449b-89e4-5394f54e36f0 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "DELETE /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/os-volume_attachments/a64efda2-7f86-4da4-b332-6cab266a6f6a" status: 202 len: 0 microversion: 2.20 time: 0.354182 Jul 26 17:20:06.813733 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 454/846] 10.222.0.48 () {60 vars in 1457 bytes} [Tue Jul 26 17:20:06 2022] DELETE /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/os-volume_attachments/a64efda2-7f86-4da4-b332-6cab266a6f6a => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:20:06.881878 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8a7f629f-85db-4043-88cf-ede1f6c7240f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:06.882474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8a7f629f-85db-4043-88cf-ede1f6c7240f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:06.891291 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8a7f629f-85db-4043-88cf-ede1f6c7240f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:06.891738 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8a7f629f-85db-4043-88cf-ede1f6c7240f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:06.892783 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8a7f629f-85db-4043-88cf-ede1f6c7240f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:06.893215 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8a7f629f-85db-4043-88cf-ede1f6c7240f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:07.002280 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8a7f629f-85db-4043-88cf-ede1f6c7240f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "POST /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/action" status: 202 len: 0 microversion: 2.20 time: 0.124408 Jul 26 17:20:07.003152 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 393/847] 10.222.0.48 () {62 vars in 1319 bytes} [Tue Jul 26 17:20:06 2022] POST /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:20:07.012841 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7565f42b-4c99-4672-8ec9-e40f249ed720 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:07.013285 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7565f42b-4c99-4672-8ec9-e40f249ed720 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:07.020540 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7565f42b-4c99-4672-8ec9-e40f249ed720 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:07.021280 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7565f42b-4c99-4672-8ec9-e40f249ed720 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:07.022150 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7565f42b-4c99-4672-8ec9-e40f249ed720 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:07.022635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7565f42b-4c99-4672-8ec9-e40f249ed720 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:07.202542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7565f42b-4c99-4672-8ec9-e40f249ed720 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:07.211069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7565f42b-4c99-4672-8ec9-e40f249ed720 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:07.212575 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7565f42b-4c99-4672-8ec9-e40f249ed720 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:07.214379 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7565f42b-4c99-4672-8ec9-e40f249ed720 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1674 microversion: 2.20 time: 0.206799 Jul 26 17:20:07.214936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 455/848] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:07 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1674 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:07.462015 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-dd162f14-e5c7-441e-bb01-e2a44d2be792 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:07.462618 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-dd162f14-e5c7-441e-bb01-e2a44d2be792 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:07.469227 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dd162f14-e5c7-441e-bb01-e2a44d2be792 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:07.469793 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dd162f14-e5c7-441e-bb01-e2a44d2be792 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:07.471551 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dd162f14-e5c7-441e-bb01-e2a44d2be792 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:07.472017 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dd162f14-e5c7-441e-bb01-e2a44d2be792 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:07.506634 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-dd162f14-e5c7-441e-bb01-e2a44d2be792 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments/5edf39ee-4e1f-4f0a-aa35-05a1083b2286" status: 200 len: 194 microversion: 2.1 time: 0.050128 Jul 26 17:20:07.507205 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 394/849] 10.222.0.48 () {58 vars in 1413 bytes} [Tue Jul 26 17:20:07 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments/5edf39ee-4e1f-4f0a-aa35-05a1083b2286 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:20:07.522537 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a787e2f8-38a7-4a12-bd3a-10fda7d94bc6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:07.523907 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a787e2f8-38a7-4a12-bd3a-10fda7d94bc6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:07.531625 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a787e2f8-38a7-4a12-bd3a-10fda7d94bc6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:07.532391 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a787e2f8-38a7-4a12-bd3a-10fda7d94bc6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:07.533344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a787e2f8-38a7-4a12-bd3a-10fda7d94bc6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:07.534735 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a787e2f8-38a7-4a12-bd3a-10fda7d94bc6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:07.662165 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-a787e2f8-38a7-4a12-bd3a-10fda7d94bc6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lazy-loading 'services' on Instance uuid 0bd0d4f3-4697-482a-a601-7bb08472adfc {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:20:07.680223 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:07.768046 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a787e2f8-38a7-4a12-bd3a-10fda7d94bc6 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments/5edf39ee-4e1f-4f0a-aa35-05a1083b2286" status: 202 len: 0 microversion: 2.1 time: 0.249419 Jul 26 17:20:07.769129 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 456/850] 10.222.0.48 () {58 vars in 1416 bytes} [Tue Jul 26 17:20:07 2022] DELETE /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments/5edf39ee-4e1f-4f0a-aa35-05a1083b2286 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:20:08.238699 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-33a40664-8538-400c-847e-c1afd2afeb52 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:08.239461 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-33a40664-8538-400c-847e-c1afd2afeb52 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:08.246597 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-33a40664-8538-400c-847e-c1afd2afeb52 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:08.247157 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-33a40664-8538-400c-847e-c1afd2afeb52 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:08.247981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-33a40664-8538-400c-847e-c1afd2afeb52 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:08.248427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-33a40664-8538-400c-847e-c1afd2afeb52 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:08.265510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:08.399410 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-33a40664-8538-400c-847e-c1afd2afeb52 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:08.407834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-33a40664-8538-400c-847e-c1afd2afeb52 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:08.409350 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-33a40664-8538-400c-847e-c1afd2afeb52 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:08.410585 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-33a40664-8538-400c-847e-c1afd2afeb52 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.176824 Jul 26 17:20:08.411061 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 395/851] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:08 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:09.438319 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-313eb98d-e5fd-4458-b369-e679aeb7b47e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:09.439016 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-313eb98d-e5fd-4458-b369-e679aeb7b47e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:09.446492 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-313eb98d-e5fd-4458-b369-e679aeb7b47e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:09.446945 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-313eb98d-e5fd-4458-b369-e679aeb7b47e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:09.447780 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-313eb98d-e5fd-4458-b369-e679aeb7b47e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:09.448215 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-313eb98d-e5fd-4458-b369-e679aeb7b47e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:09.602127 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-313eb98d-e5fd-4458-b369-e679aeb7b47e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:09.610973 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-313eb98d-e5fd-4458-b369-e679aeb7b47e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:09.612470 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-313eb98d-e5fd-4458-b369-e679aeb7b47e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:09.613665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-313eb98d-e5fd-4458-b369-e679aeb7b47e tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.180687 Jul 26 17:20:09.614216 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 457/852] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:09 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:10.057454 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d083d6ec-d178-45fd-bafc-558fbfcc966b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:10.060341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d083d6ec-d178-45fd-bafc-558fbfcc966b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:10.067897 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d083d6ec-d178-45fd-bafc-558fbfcc966b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.068359 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d083d6ec-d178-45fd-bafc-558fbfcc966b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.069321 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d083d6ec-d178-45fd-bafc-558fbfcc966b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.069759 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d083d6ec-d178-45fd-bafc-558fbfcc966b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.110132 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d083d6ec-d178-45fd-bafc-558fbfcc966b tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057727 Jul 26 17:20:10.110955 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 396/853] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:20:10 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 17:20:10.267900 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-55899be7-6b8f-4a31-a8d5-22a70fc41bf4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:10.271822 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-55899be7-6b8f-4a31-a8d5-22a70fc41bf4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:10.283304 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55899be7-6b8f-4a31-a8d5-22a70fc41bf4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.284245 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55899be7-6b8f-4a31-a8d5-22a70fc41bf4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.286016 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55899be7-6b8f-4a31-a8d5-22a70fc41bf4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.286815 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55899be7-6b8f-4a31-a8d5-22a70fc41bf4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.329052 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-55899be7-6b8f-4a31-a8d5-22a70fc41bf4 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067113 Jul 26 17:20:10.329827 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 458/854] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:20:10 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 17:20:10.402236 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-d8d09ba4-2f70-443d-b648-a12fc8c78788 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:10.405887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d8d09ba4-2f70-443d-b648-a12fc8c78788 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:10.412425 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d8d09ba4-2f70-443d-b648-a12fc8c78788 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.412850 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d8d09ba4-2f70-443d-b648-a12fc8c78788 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.413650 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d8d09ba4-2f70-443d-b648-a12fc8c78788 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.414084 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-d8d09ba4-2f70-443d-b648-a12fc8c78788 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.441572 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-d8d09ba4-2f70-443d-b648-a12fc8c78788 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Going to try to terminate instance {{(pid=118122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:20:10.443534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c3962cce-1c35-42cc-a313-7900e8b4bef6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:10.444205 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c3962cce-1c35-42cc-a313-7900e8b4bef6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:10.451611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3962cce-1c35-42cc-a313-7900e8b4bef6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.452081 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3962cce-1c35-42cc-a313-7900e8b4bef6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.453097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3962cce-1c35-42cc-a313-7900e8b4bef6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.453745 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3962cce-1c35-42cc-a313-7900e8b4bef6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.502508 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-c3962cce-1c35-42cc-a313-7900e8b4bef6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lazy-loading 'flavor' on Instance uuid 95b93f34-9005-40dc-acb1-496c1eaf53c6 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:20:10.539198 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-d8d09ba4-2f70-443d-b648-a12fc8c78788 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 204 len: 0 microversion: 2.1 time: 0.141213 Jul 26 17:20:10.540324 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 397/855] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:20:10 2022] DELETE /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:20:10.554778 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-84b2c36a-af63-46bd-97c5-bf8bea645d63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:10.555927 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-84b2c36a-af63-46bd-97c5-bf8bea645d63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:10.566557 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84b2c36a-af63-46bd-97c5-bf8bea645d63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.567072 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84b2c36a-af63-46bd-97c5-bf8bea645d63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.567894 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84b2c36a-af63-46bd-97c5-bf8bea645d63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.568329 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84b2c36a-af63-46bd-97c5-bf8bea645d63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.616354 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c3962cce-1c35-42cc-a313-7900e8b4bef6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "POST /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6/action" status: 202 len: 0 microversion: 2.1 time: 0.177706 Jul 26 17:20:10.617308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 459/856] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:20:10 2022] POST /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 17:20:10.627210 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-69424b13-8f58-42d8-ae55-cfefbcbde1ea tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:10.627923 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-69424b13-8f58-42d8-ae55-cfefbcbde1ea tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:10.636073 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69424b13-8f58-42d8-ae55-cfefbcbde1ea tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.636896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69424b13-8f58-42d8-ae55-cfefbcbde1ea tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.638372 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69424b13-8f58-42d8-ae55-cfefbcbde1ea tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.642548 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69424b13-8f58-42d8-ae55-cfefbcbde1ea tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.772419 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-84b2c36a-af63-46bd-97c5-bf8bea645d63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:10.784725 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-84b2c36a-af63-46bd-97c5-bf8bea645d63 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1672 microversion: 2.1 time: 0.235585 Jul 26 17:20:10.804987 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 398/857] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:10 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1672 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:10.804987 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2abaf9b3-5780-406b-9d7a-d9f5b942ac55 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:10.804987 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2abaf9b3-5780-406b-9d7a-d9f5b942ac55 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:10.804987 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2abaf9b3-5780-406b-9d7a-d9f5b942ac55 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.805505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2abaf9b3-5780-406b-9d7a-d9f5b942ac55 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.805505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2abaf9b3-5780-406b-9d7a-d9f5b942ac55 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:10.805505 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2abaf9b3-5780-406b-9d7a-d9f5b942ac55 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:10.901013 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-69424b13-8f58-42d8-ae55-cfefbcbde1ea tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:10.912040 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-69424b13-8f58-42d8-ae55-cfefbcbde1ea tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.289210 Jul 26 17:20:10.933760 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 460/858] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:10 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:20:11.022428 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-2abaf9b3-5780-406b-9d7a-d9f5b942ac55 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:11.031384 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-2abaf9b3-5780-406b-9d7a-d9f5b942ac55 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:11.032844 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-2abaf9b3-5780-406b-9d7a-d9f5b942ac55 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:11.034391 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2abaf9b3-5780-406b-9d7a-d9f5b942ac55 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.247659 Jul 26 17:20:11.035355 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 399/859] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:10 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:11.815526 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8a1c2224-944c-4163-9149-f137862077ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:11.816126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8a1c2224-944c-4163-9149-f137862077ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:11.823532 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a1c2224-944c-4163-9149-f137862077ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:11.823975 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a1c2224-944c-4163-9149-f137862077ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:11.824765 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a1c2224-944c-4163-9149-f137862077ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:11.825300 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a1c2224-944c-4163-9149-f137862077ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:11.947834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1c076fdd-e5ad-432e-880e-4443ae0dcb88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:11.949046 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1c076fdd-e5ad-432e-880e-4443ae0dcb88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:11.974116 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c076fdd-e5ad-432e-880e-4443ae0dcb88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:11.974967 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c076fdd-e5ad-432e-880e-4443ae0dcb88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:11.976398 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c076fdd-e5ad-432e-880e-4443ae0dcb88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:11.977240 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1c076fdd-e5ad-432e-880e-4443ae0dcb88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:11.999535 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8a1c2224-944c-4163-9149-f137862077ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:12.011178 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8a1c2224-944c-4163-9149-f137862077ba tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1672 microversion: 2.1 time: 0.199023 Jul 26 17:20:12.026974 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 461/860] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:11 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1672 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:12.063622 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-73a3a3d5-88a6-4975-a204-bbd71625d5e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:12.064770 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-73a3a3d5-88a6-4975-a204-bbd71625d5e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:12.077274 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73a3a3d5-88a6-4975-a204-bbd71625d5e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:12.078743 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73a3a3d5-88a6-4975-a204-bbd71625d5e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:12.081078 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73a3a3d5-88a6-4975-a204-bbd71625d5e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:12.081078 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73a3a3d5-88a6-4975-a204-bbd71625d5e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:12.208896 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1c076fdd-e5ad-432e-880e-4443ae0dcb88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:12.218012 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1c076fdd-e5ad-432e-880e-4443ae0dcb88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.279466 Jul 26 17:20:12.218804 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 400/861] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:11 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:12.290222 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-73a3a3d5-88a6-4975-a204-bbd71625d5e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:12.299099 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-73a3a3d5-88a6-4975-a204-bbd71625d5e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:12.301315 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-73a3a3d5-88a6-4975-a204-bbd71625d5e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:12.303211 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-73a3a3d5-88a6-4975-a204-bbd71625d5e7 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.246945 Jul 26 17:20:12.318986 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 462/862] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:12 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:13.036676 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-62edbc9c-3c9b-46fc-bd1a-394ea7940a9e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:13.037957 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-62edbc9c-3c9b-46fc-bd1a-394ea7940a9e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:13.049073 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-62edbc9c-3c9b-46fc-bd1a-394ea7940a9e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:13.049536 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-62edbc9c-3c9b-46fc-bd1a-394ea7940a9e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:13.050376 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-62edbc9c-3c9b-46fc-bd1a-394ea7940a9e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:13.050890 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-62edbc9c-3c9b-46fc-bd1a-394ea7940a9e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:13.214301 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-62edbc9c-3c9b-46fc-bd1a-394ea7940a9e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:13.225580 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-62edbc9c-3c9b-46fc-bd1a-394ea7940a9e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1672 microversion: 2.1 time: 0.194498 Jul 26 17:20:13.226388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 401/863] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:13 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:20:13.239668 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1b777f6-d152-4f79-9f40-8ab589bb80ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:13.240901 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1b777f6-d152-4f79-9f40-8ab589bb80ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:13.248426 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1b777f6-d152-4f79-9f40-8ab589bb80ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:13.248873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1b777f6-d152-4f79-9f40-8ab589bb80ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:13.249968 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1b777f6-d152-4f79-9f40-8ab589bb80ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:13.250399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1b777f6-d152-4f79-9f40-8ab589bb80ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:13.351498 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3a6980b3-2347-449f-8fbc-4769525e14c5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:13.352337 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3a6980b3-2347-449f-8fbc-4769525e14c5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:13.359658 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3a6980b3-2347-449f-8fbc-4769525e14c5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:13.360224 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3a6980b3-2347-449f-8fbc-4769525e14c5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:13.361156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3a6980b3-2347-449f-8fbc-4769525e14c5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:13.361680 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3a6980b3-2347-449f-8fbc-4769525e14c5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:13.397128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1b777f6-d152-4f79-9f40-8ab589bb80ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:13.411736 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1b777f6-d152-4f79-9f40-8ab589bb80ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.175657 Jul 26 17:20:13.412513 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 463/864] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:13 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:13.543460 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3a6980b3-2347-449f-8fbc-4769525e14c5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:13.552105 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3a6980b3-2347-449f-8fbc-4769525e14c5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:13.553647 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3a6980b3-2347-449f-8fbc-4769525e14c5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:13.554807 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3a6980b3-2347-449f-8fbc-4769525e14c5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.208248 Jul 26 17:20:13.555371 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 402/865] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:13 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:14.248969 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c354a0f9-25de-460d-9d32-5e4a61088604 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:14.249981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c354a0f9-25de-460d-9d32-5e4a61088604 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:14.257964 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c354a0f9-25de-460d-9d32-5e4a61088604 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:14.258409 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c354a0f9-25de-460d-9d32-5e4a61088604 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:14.259644 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c354a0f9-25de-460d-9d32-5e4a61088604 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:14.260367 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c354a0f9-25de-460d-9d32-5e4a61088604 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:14.434987 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4a8a1cb3-3955-40be-8fd9-a37e03e9d5fa tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:14.435610 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4a8a1cb3-3955-40be-8fd9-a37e03e9d5fa tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:14.450392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4a8a1cb3-3955-40be-8fd9-a37e03e9d5fa tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:14.451108 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4a8a1cb3-3955-40be-8fd9-a37e03e9d5fa tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:14.452062 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4a8a1cb3-3955-40be-8fd9-a37e03e9d5fa tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:14.452675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4a8a1cb3-3955-40be-8fd9-a37e03e9d5fa tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:14.464075 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c354a0f9-25de-460d-9d32-5e4a61088604 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:14.479455 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c354a0f9-25de-460d-9d32-5e4a61088604 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1672 microversion: 2.1 time: 0.234080 Jul 26 17:20:14.480625 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 464/866] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:14 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1672 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:14.578754 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bf57dd5a-68f1-40ab-bca1-567d8f393dc4 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:14.579374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bf57dd5a-68f1-40ab-bca1-567d8f393dc4 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:14.594906 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf57dd5a-68f1-40ab-bca1-567d8f393dc4 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:14.595360 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf57dd5a-68f1-40ab-bca1-567d8f393dc4 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:14.596950 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf57dd5a-68f1-40ab-bca1-567d8f393dc4 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:14.597723 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf57dd5a-68f1-40ab-bca1-567d8f393dc4 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:14.660194 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4a8a1cb3-3955-40be-8fd9-a37e03e9d5fa tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:14.670364 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4a8a1cb3-3955-40be-8fd9-a37e03e9d5fa tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.239458 Jul 26 17:20:14.671853 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 403/867] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:14 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:14.790094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bf57dd5a-68f1-40ab-bca1-567d8f393dc4 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:14.799055 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bf57dd5a-68f1-40ab-bca1-567d8f393dc4 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:14.800573 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bf57dd5a-68f1-40ab-bca1-567d8f393dc4 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:14.802337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bf57dd5a-68f1-40ab-bca1-567d8f393dc4 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.227449 Jul 26 17:20:14.802504 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 465/868] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:14 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:15.502720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5f73e454-89f7-4341-b64d-e17bc1ec3b85 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:15.503354 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5f73e454-89f7-4341-b64d-e17bc1ec3b85 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:15.510185 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5f73e454-89f7-4341-b64d-e17bc1ec3b85 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:15.510481 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5f73e454-89f7-4341-b64d-e17bc1ec3b85 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:15.511255 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5f73e454-89f7-4341-b64d-e17bc1ec3b85 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:15.511696 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5f73e454-89f7-4341-b64d-e17bc1ec3b85 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:15.663680 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5f73e454-89f7-4341-b64d-e17bc1ec3b85 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:15.674563 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5f73e454-89f7-4341-b64d-e17bc1ec3b85 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1672 microversion: 2.1 time: 0.175794 Jul 26 17:20:15.676613 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 404/869] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:15 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:15.695577 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-edd2908a-30b4-4d1f-8d18-440645b32459 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:15.697985 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-edd2908a-30b4-4d1f-8d18-440645b32459 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:15.705750 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edd2908a-30b4-4d1f-8d18-440645b32459 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:15.706197 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edd2908a-30b4-4d1f-8d18-440645b32459 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:15.706969 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edd2908a-30b4-4d1f-8d18-440645b32459 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:15.707399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edd2908a-30b4-4d1f-8d18-440645b32459 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:15.824867 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4d7353ff-86f2-493f-9411-899426f98011 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:15.825572 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4d7353ff-86f2-493f-9411-899426f98011 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:15.837606 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4d7353ff-86f2-493f-9411-899426f98011 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:15.838396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4d7353ff-86f2-493f-9411-899426f98011 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:15.839253 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4d7353ff-86f2-493f-9411-899426f98011 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:15.839732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4d7353ff-86f2-493f-9411-899426f98011 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:15.931376 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-edd2908a-30b4-4d1f-8d18-440645b32459 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:15.940001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-edd2908a-30b4-4d1f-8d18-440645b32459 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.248082 Jul 26 17:20:15.940650 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 466/870] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:15 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:16.009385 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4d7353ff-86f2-493f-9411-899426f98011 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:16.017587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4d7353ff-86f2-493f-9411-899426f98011 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:16.019023 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4d7353ff-86f2-493f-9411-899426f98011 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:16.020190 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4d7353ff-86f2-493f-9411-899426f98011 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.199756 Jul 26 17:20:16.031838 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 405/871] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:15 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:16.698524 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-33efac48-3468-4940-9aeb-fcb33daa4aaf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:16.700133 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-33efac48-3468-4940-9aeb-fcb33daa4aaf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:16.708263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33efac48-3468-4940-9aeb-fcb33daa4aaf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:16.708642 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33efac48-3468-4940-9aeb-fcb33daa4aaf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:16.709477 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33efac48-3468-4940-9aeb-fcb33daa4aaf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:16.711263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33efac48-3468-4940-9aeb-fcb33daa4aaf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:16.911849 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-33efac48-3468-4940-9aeb-fcb33daa4aaf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:16.922043 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-33efac48-3468-4940-9aeb-fcb33daa4aaf tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1672 microversion: 2.1 time: 0.228566 Jul 26 17:20:16.926442 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 467/872] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:16 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1672 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:16.964709 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b5d116c0-1000-4032-9624-295cbc9ede87 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:16.966075 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b5d116c0-1000-4032-9624-295cbc9ede87 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:16.974960 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b5d116c0-1000-4032-9624-295cbc9ede87 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:16.975886 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b5d116c0-1000-4032-9624-295cbc9ede87 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:16.977149 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b5d116c0-1000-4032-9624-295cbc9ede87 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:16.977739 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b5d116c0-1000-4032-9624-295cbc9ede87 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:17.046737 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-19183291-3934-4808-ad4a-d9d16b88f33b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:17.047985 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-19183291-3934-4808-ad4a-d9d16b88f33b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:17.054818 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19183291-3934-4808-ad4a-d9d16b88f33b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:17.055589 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19183291-3934-4808-ad4a-d9d16b88f33b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:17.056907 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19183291-3934-4808-ad4a-d9d16b88f33b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:17.058542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19183291-3934-4808-ad4a-d9d16b88f33b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:17.218562 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-b5d116c0-1000-4032-9624-295cbc9ede87 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:17.226298 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b5d116c0-1000-4032-9624-295cbc9ede87 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.268338 Jul 26 17:20:17.227054 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 406/873] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:16 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:17.290227 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-19183291-3934-4808-ad4a-d9d16b88f33b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:17.299288 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-19183291-3934-4808-ad4a-d9d16b88f33b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:17.301141 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-19183291-3934-4808-ad4a-d9d16b88f33b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:17.302880 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-19183291-3934-4808-ad4a-d9d16b88f33b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.260126 Jul 26 17:20:17.304094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 468/874] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:17 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:17.955685 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8503b704-276c-4095-aaf2-9a92e98d33f9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:17.956425 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8503b704-276c-4095-aaf2-9a92e98d33f9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:17.964725 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8503b704-276c-4095-aaf2-9a92e98d33f9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:17.965450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8503b704-276c-4095-aaf2-9a92e98d33f9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:17.966062 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8503b704-276c-4095-aaf2-9a92e98d33f9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:17.966527 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8503b704-276c-4095-aaf2-9a92e98d33f9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:18.118334 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8503b704-276c-4095-aaf2-9a92e98d33f9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:18.127798 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8503b704-276c-4095-aaf2-9a92e98d33f9 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1672 microversion: 2.1 time: 0.175593 Jul 26 17:20:18.128654 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 407/875] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:17 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:18.249671 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0d77734b-2ccd-4f57-9b7b-b76fa486d91e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:18.250263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0d77734b-2ccd-4f57-9b7b-b76fa486d91e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:18.258017 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d77734b-2ccd-4f57-9b7b-b76fa486d91e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:18.258450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d77734b-2ccd-4f57-9b7b-b76fa486d91e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:18.260649 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d77734b-2ccd-4f57-9b7b-b76fa486d91e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:18.261211 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d77734b-2ccd-4f57-9b7b-b76fa486d91e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:18.327418 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9b27ffae-13f6-4c0b-87ed-2b9144bd2b2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:18.328023 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9b27ffae-13f6-4c0b-87ed-2b9144bd2b2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:18.334105 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9b27ffae-13f6-4c0b-87ed-2b9144bd2b2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:18.334555 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9b27ffae-13f6-4c0b-87ed-2b9144bd2b2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:18.335351 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9b27ffae-13f6-4c0b-87ed-2b9144bd2b2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:18.335785 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9b27ffae-13f6-4c0b-87ed-2b9144bd2b2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:18.404214 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0d77734b-2ccd-4f57-9b7b-b76fa486d91e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:18.412554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0d77734b-2ccd-4f57-9b7b-b76fa486d91e tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.166889 Jul 26 17:20:18.413161 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 469/876] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:18 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:18.473470 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9b27ffae-13f6-4c0b-87ed-2b9144bd2b2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:18.482286 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9b27ffae-13f6-4c0b-87ed-2b9144bd2b2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:18.483829 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9b27ffae-13f6-4c0b-87ed-2b9144bd2b2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:18.485014 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9b27ffae-13f6-4c0b-87ed-2b9144bd2b2b tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.162250 Jul 26 17:20:18.485582 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 408/877] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:18 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:20:18.550291 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9e16977e-dcc0-44df-9302-913fd8046008 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:18.550705 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9e16977e-dcc0-44df-9302-913fd8046008 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:18.556925 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e16977e-dcc0-44df-9302-913fd8046008 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:18.557414 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e16977e-dcc0-44df-9302-913fd8046008 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:18.558185 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e16977e-dcc0-44df-9302-913fd8046008 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:18.558657 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e16977e-dcc0-44df-9302-913fd8046008 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:18.584147 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9e16977e-dcc0-44df-9302-913fd8046008 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/ips" status: 200 len: 148 microversion: 2.1 time: 0.037587 Jul 26 17:20:18.585145 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 470/878] 10.222.0.48 () {58 vars in 1248 bytes} [Tue Jul 26 17:20:18 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:20:19.152409 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a7a28d7c-6628-4986-9a33-9548dbdcfa86 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:19.153055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a7a28d7c-6628-4986-9a33-9548dbdcfa86 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:19.159526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7a28d7c-6628-4986-9a33-9548dbdcfa86 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:19.159971 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7a28d7c-6628-4986-9a33-9548dbdcfa86 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:19.160733 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7a28d7c-6628-4986-9a33-9548dbdcfa86 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:19.161189 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a7a28d7c-6628-4986-9a33-9548dbdcfa86 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:19.297216 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a7a28d7c-6628-4986-9a33-9548dbdcfa86 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:19.304972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a7a28d7c-6628-4986-9a33-9548dbdcfa86 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1672 microversion: 2.1 time: 0.156935 Jul 26 17:20:19.305641 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 409/879] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:19 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:19.434141 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8c05dbf1-df23-4e4c-b9ce-0cdf79924cae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:19.434753 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8c05dbf1-df23-4e4c-b9ce-0cdf79924cae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:19.441299 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c05dbf1-df23-4e4c-b9ce-0cdf79924cae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:19.441751 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c05dbf1-df23-4e4c-b9ce-0cdf79924cae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:19.442518 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c05dbf1-df23-4e4c-b9ce-0cdf79924cae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:19.442960 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c05dbf1-df23-4e4c-b9ce-0cdf79924cae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:19.461774 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:19.508697 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0283d6d9-f054-44c1-9df2-78f11a103ebf tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:19.509931 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0283d6d9-f054-44c1-9df2-78f11a103ebf tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:19.516411 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0283d6d9-f054-44c1-9df2-78f11a103ebf tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:19.516901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0283d6d9-f054-44c1-9df2-78f11a103ebf tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:19.517630 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0283d6d9-f054-44c1-9df2-78f11a103ebf tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:19.518067 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0283d6d9-f054-44c1-9df2-78f11a103ebf tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:19.534050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:19.582051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8c05dbf1-df23-4e4c-b9ce-0cdf79924cae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:19.591226 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8c05dbf1-df23-4e4c-b9ce-0cdf79924cae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.161330 Jul 26 17:20:19.591930 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 471/880] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:19 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:19.662397 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0283d6d9-f054-44c1-9df2-78f11a103ebf tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:19.670666 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0283d6d9-f054-44c1-9df2-78f11a103ebf tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:19.672168 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0283d6d9-f054-44c1-9df2-78f11a103ebf tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:19.673439 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0283d6d9-f054-44c1-9df2-78f11a103ebf tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.168643 Jul 26 17:20:19.674033 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 410/881] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:19 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:20:19.919132 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e7d74280-e0e6-4b2c-ad95-77e2ff62ff5f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48ccc540-de11-47bb-a2f1-8e0648b13019"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:19.921554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e7d74280-e0e6-4b2c-ad95-77e2ff62ff5f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:19.927560 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e7d74280-e0e6-4b2c-ad95-77e2ff62ff5f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:19.928006 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e7d74280-e0e6-4b2c-ad95-77e2ff62ff5f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:19.928771 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e7d74280-e0e6-4b2c-ad95-77e2ff62ff5f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:19.929231 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e7d74280-e0e6-4b2c-ad95-77e2ff62ff5f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:20.327200 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3d06da7c-fb58-4590-933c-2d0c9b1a155e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:20.327816 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3d06da7c-fb58-4590-933c-2d0c9b1a155e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:20.334293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3d06da7c-fb58-4590-933c-2d0c9b1a155e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:20.334744 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3d06da7c-fb58-4590-933c-2d0c9b1a155e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:20.335516 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3d06da7c-fb58-4590-933c-2d0c9b1a155e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:20.335953 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3d06da7c-fb58-4590-933c-2d0c9b1a155e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:20.476008 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3d06da7c-fb58-4590-933c-2d0c9b1a155e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:20.487088 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3d06da7c-fb58-4590-933c-2d0c9b1a155e tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1672 microversion: 2.1 time: 0.163633 Jul 26 17:20:20.487673 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 411/882] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:20 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:20:20.613676 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3738f293-ee83-4faa-ad3c-c5bd87424fb7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:20.614292 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3738f293-ee83-4faa-ad3c-c5bd87424fb7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:20.621780 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3738f293-ee83-4faa-ad3c-c5bd87424fb7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:20.622234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3738f293-ee83-4faa-ad3c-c5bd87424fb7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:20.623011 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3738f293-ee83-4faa-ad3c-c5bd87424fb7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:20.623450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3738f293-ee83-4faa-ad3c-c5bd87424fb7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:20.781778 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3738f293-ee83-4faa-ad3c-c5bd87424fb7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:20.791080 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3738f293-ee83-4faa-ad3c-c5bd87424fb7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.181309 Jul 26 17:20:20.791776 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 412/883] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:20 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:20:20.802444 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c833ae43-a248-48cc-b5fa-e5c8f1a4e415 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:20.803056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c833ae43-a248-48cc-b5fa-e5c8f1a4e415 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:20.811888 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c833ae43-a248-48cc-b5fa-e5c8f1a4e415 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:20.812363 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c833ae43-a248-48cc-b5fa-e5c8f1a4e415 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:20.813171 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c833ae43-a248-48cc-b5fa-e5c8f1a4e415 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:20.813797 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c833ae43-a248-48cc-b5fa-e5c8f1a4e415 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:20.861650 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e7d74280-e0e6-4b2c-ad95-77e2ff62ff5f tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "POST /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.946257 Jul 26 17:20:20.862430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 472/884] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:20:19 2022] POST /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/os-volume_attachments => generated 194 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:20:21.018433 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c833ae43-a248-48cc-b5fa-e5c8f1a4e415 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:21.027242 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c833ae43-a248-48cc-b5fa-e5c8f1a4e415 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:21.028529 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c833ae43-a248-48cc-b5fa-e5c8f1a4e415 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:21.029745 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c833ae43-a248-48cc-b5fa-e5c8f1a4e415 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.231522 Jul 26 17:20:21.031033 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 413/885] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:20 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:21.511997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8c58b93e-711e-42d3-a275-36c419a71cda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:21.512699 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8c58b93e-711e-42d3-a275-36c419a71cda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:21.519344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c58b93e-711e-42d3-a275-36c419a71cda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:21.519832 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c58b93e-711e-42d3-a275-36c419a71cda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:21.520601 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c58b93e-711e-42d3-a275-36c419a71cda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:21.521067 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c58b93e-711e-42d3-a275-36c419a71cda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:21.768193 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8c58b93e-711e-42d3-a275-36c419a71cda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:21.777817 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8c58b93e-711e-42d3-a275-36c419a71cda tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1672 microversion: 2.1 time: 0.271181 Jul 26 17:20:21.778401 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 473/886] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:21 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1672 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:21.815313 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-fd77e913-b91b-46e2-baf5-67b539e48131 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:21.818988 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-fd77e913-b91b-46e2-baf5-67b539e48131 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:21.828923 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:21.830615 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd77e913-b91b-46e2-baf5-67b539e48131 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:21.831650 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd77e913-b91b-46e2-baf5-67b539e48131 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:21.832441 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd77e913-b91b-46e2-baf5-67b539e48131 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:21.832905 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fd77e913-b91b-46e2-baf5-67b539e48131 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:21.998535 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-fd77e913-b91b-46e2-baf5-67b539e48131 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:22.007444 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-fd77e913-b91b-46e2-baf5-67b539e48131 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.198016 Jul 26 17:20:22.008076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 414/887] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:21 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:20:22.053813 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-338be5c5-1d18-4872-b751-212bbd4a52a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:22.054725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-338be5c5-1d18-4872-b751-212bbd4a52a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:22.062221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-338be5c5-1d18-4872-b751-212bbd4a52a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:22.062753 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-338be5c5-1d18-4872-b751-212bbd4a52a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:22.063611 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-338be5c5-1d18-4872-b751-212bbd4a52a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:22.064124 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-338be5c5-1d18-4872-b751-212bbd4a52a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:22.286867 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-338be5c5-1d18-4872-b751-212bbd4a52a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:22.299356 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-338be5c5-1d18-4872-b751-212bbd4a52a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:22.301374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-338be5c5-1d18-4872-b751-212bbd4a52a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:22.302948 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-338be5c5-1d18-4872-b751-212bbd4a52a9 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.253352 Jul 26 17:20:22.303697 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 474/888] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:22 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:22.657940 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-fe4b24ea-c158-4e61-81cf-126deb4f4538 req-edf97abb-f788-467b-862b-0c0dbe03a8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bd0d4f3-4697-482a-a601-7bb08472adfc", "name": "network-vif-deleted", "tag": "690c7a63-c7a8-4fc8-8076-272d7bf01fee"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:22.670619 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-fe4b24ea-c158-4e61-81cf-126deb4f4538 req-edf97abb-f788-467b-862b-0c0dbe03a8ef service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:22.671094 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-fe4b24ea-c158-4e61-81cf-126deb4f4538 req-edf97abb-f788-467b-862b-0c0dbe03a8ef service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:22.684747 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-fe4b24ea-c158-4e61-81cf-126deb4f4538 req-edf97abb-f788-467b-862b-0c0dbe03a8ef service nova] Creating event network-vif-deleted:690c7a63-c7a8-4fc8-8076-272d7bf01fee for instance 0bd0d4f3-4697-482a-a601-7bb08472adfc on hv-cinder-83538 Jul 26 17:20:22.691621 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-fe4b24ea-c158-4e61-81cf-126deb4f4538 req-edf97abb-f788-467b-862b-0c0dbe03a8ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036672 Jul 26 17:20:22.692341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 415/889] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:20:22.800256 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8a3c5fa6-0c21-4f54-b956-fa2558070641 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:22.800871 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8a3c5fa6-0c21-4f54-b956-fa2558070641 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:22.808814 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a3c5fa6-0c21-4f54-b956-fa2558070641 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:22.809337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a3c5fa6-0c21-4f54-b956-fa2558070641 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:22.810112 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a3c5fa6-0c21-4f54-b956-fa2558070641 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:22.810544 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a3c5fa6-0c21-4f54-b956-fa2558070641 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:22.851004 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a3c5fa6-0c21-4f54-b956-fa2558070641 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:22.851723 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a3c5fa6-0c21-4f54-b956-fa2558070641 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:22.852470 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-8a3c5fa6-0c21-4f54-b956-fa2558070641 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lazy-loading 'fault' on Instance uuid 0bd0d4f3-4697-482a-a601-7bb08472adfc {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:20:22.900259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8a3c5fa6-0c21-4f54-b956-fa2558070641 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '459db7ff580948dc853b9f843700fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7fbc938d614078b719aa483aa80cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:22.909106 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8a3c5fa6-0c21-4f54-b956-fa2558070641 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 200 len: 1327 microversion: 2.1 time: 0.113147 Jul 26 17:20:22.917221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 475/890] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:22 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:23.029835 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-aab4fc2f-062b-4f4d-82ce-5e454696e2b6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:23.030536 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-aab4fc2f-062b-4f4d-82ce-5e454696e2b6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:23.047679 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aab4fc2f-062b-4f4d-82ce-5e454696e2b6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:23.047679 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aab4fc2f-062b-4f4d-82ce-5e454696e2b6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:23.047679 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aab4fc2f-062b-4f4d-82ce-5e454696e2b6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:23.047679 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aab4fc2f-062b-4f4d-82ce-5e454696e2b6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:23.198973 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-aab4fc2f-062b-4f4d-82ce-5e454696e2b6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:23.209986 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-aab4fc2f-062b-4f4d-82ce-5e454696e2b6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.184340 Jul 26 17:20:23.210564 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 416/891] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:23 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:23.328499 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-32f31551-a0e1-471d-a00f-7139186531fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:23.329215 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-32f31551-a0e1-471d-a00f-7139186531fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:23.335561 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32f31551-a0e1-471d-a00f-7139186531fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:23.336006 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32f31551-a0e1-471d-a00f-7139186531fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:23.336814 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32f31551-a0e1-471d-a00f-7139186531fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:23.337325 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32f31551-a0e1-471d-a00f-7139186531fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:23.482759 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-32f31551-a0e1-471d-a00f-7139186531fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:23.491700 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-32f31551-a0e1-471d-a00f-7139186531fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:23.493558 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-32f31551-a0e1-471d-a00f-7139186531fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:23.494891 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-32f31551-a0e1-471d-a00f-7139186531fa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.170409 Jul 26 17:20:23.495450 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 476/892] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:23 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:20:23.931291 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5897b838-ce2f-4f35-b54b-4a105a25d32d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:23.931902 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5897b838-ce2f-4f35-b54b-4a105a25d32d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:23.937896 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5897b838-ce2f-4f35-b54b-4a105a25d32d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:23.938340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5897b838-ce2f-4f35-b54b-4a105a25d32d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:23.939109 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5897b838-ce2f-4f35-b54b-4a105a25d32d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:23.939536 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5897b838-ce2f-4f35-b54b-4a105a25d32d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:23.955177 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-5897b838-ce2f-4f35-b54b-4a105a25d32d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] HTTP exception thrown: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5897b838-ce2f-4f35-b54b-4a105a25d32d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Request method failure captured: Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc HTTP/1.1 Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CC8XEx5Rtb0mXla7Ve2uAgbG9ZkDE9Lrp3gFHxtMJ-cnR5xJniJHbZKg3CkKepAd7xwyKfWKelAvBA9Oo2enkNrApvDbmbwv2i1jX4zlCB6g3tkP7TOvjMQJ6S_ryqrSvj0F15P14xR1ivj7qVjBzfBlPp8C5CoBlR-ipNg4QbSL4c Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 6f7fbc938d614078b719aa483aa80cd6 Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:20:23.956818 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:20:23.958515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:23.958515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:23.958515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 6f7fbc938d614078b719aa483aa80cd6 Jul 26 17:20:23.958515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:23.958515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeTestJSON-329568771-project Jul 26 17:20:23.958515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:20:23.958515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:20:23.958515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: 459db7ff580948dc853b9f843700fe3c Jul 26 17:20:23.958515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeTestJSON-329568771-project Jul 26 17:20:23.958515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:20:23.958515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:23.958515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '0bd0d4f3-4697-482a-a601-7bb08472adfc'} Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:23.959415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:23.961078 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:23.964073 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5897b838-ce2f-4f35-b54b-4a105a25d32d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Returning 404 to user: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:23.964073 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5897b838-ce2f-4f35-b54b-4a105a25d32d tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 404 len: 111 microversion: 2.1 time: 0.030787 Jul 26 17:20:23.964073 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 417/893] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:23 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:23.968843 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6d556a50-9488-4007-91b7-38d3b8260bb3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '.version_select at 0x7f6ca8942040>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:23.994599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6d556a50-9488-4007-91b7-38d3b8260bb3 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-632008487" status: 202 len: 0 microversion: 2.1 time: 0.029926 Jul 26 17:20:23.995924 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 477/894] 10.222.0.48 () {58 vars in 1218 bytes} [Tue Jul 26 17:20:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-632008487 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 17:20:24.232339 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ecf36d19-a1db-4503-8436-382db024b268 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:24.232941 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ecf36d19-a1db-4503-8436-382db024b268 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:24.239626 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ecf36d19-a1db-4503-8436-382db024b268 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:24.240068 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ecf36d19-a1db-4503-8436-382db024b268 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:24.240833 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ecf36d19-a1db-4503-8436-382db024b268 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:24.241293 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ecf36d19-a1db-4503-8436-382db024b268 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:24.399713 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ecf36d19-a1db-4503-8436-382db024b268 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:24.408646 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ecf36d19-a1db-4503-8436-382db024b268 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.180266 Jul 26 17:20:24.409362 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 418/895] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:24 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:24.518279 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-76c6d484-3533-4460-a5a1-ad9d7f2c2654 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:24.518820 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-76c6d484-3533-4460-a5a1-ad9d7f2c2654 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:24.524791 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76c6d484-3533-4460-a5a1-ad9d7f2c2654 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:24.525328 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76c6d484-3533-4460-a5a1-ad9d7f2c2654 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:24.526301 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76c6d484-3533-4460-a5a1-ad9d7f2c2654 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:24.526732 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76c6d484-3533-4460-a5a1-ad9d7f2c2654 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:24.741746 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-76c6d484-3533-4460-a5a1-ad9d7f2c2654 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:24.754289 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-76c6d484-3533-4460-a5a1-ad9d7f2c2654 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:24.755864 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-76c6d484-3533-4460-a5a1-ad9d7f2c2654 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:24.757577 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-76c6d484-3533-4460-a5a1-ad9d7f2c2654 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.243301 Jul 26 17:20:24.758147 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 478/896] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:24 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:25.430125 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-946d2e15-3bc3-470b-b61e-f05ad3f2ecb0 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:25.431356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-946d2e15-3bc3-470b-b61e-f05ad3f2ecb0 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:25.437921 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-946d2e15-3bc3-470b-b61e-f05ad3f2ecb0 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:25.438383 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-946d2e15-3bc3-470b-b61e-f05ad3f2ecb0 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:25.439156 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-946d2e15-3bc3-470b-b61e-f05ad3f2ecb0 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:25.439747 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-946d2e15-3bc3-470b-b61e-f05ad3f2ecb0 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:25.575304 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-946d2e15-3bc3-470b-b61e-f05ad3f2ecb0 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:25.583206 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-946d2e15-3bc3-470b-b61e-f05ad3f2ecb0 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.156913 Jul 26 17:20:25.583787 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 419/897] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:25 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:25.782079 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e0c95223-aae4-4dda-a049-fe7b05f784b3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:25.782710 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e0c95223-aae4-4dda-a049-fe7b05f784b3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:25.785201 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:25.793491 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0c95223-aae4-4dda-a049-fe7b05f784b3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:25.794031 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0c95223-aae4-4dda-a049-fe7b05f784b3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:25.794906 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0c95223-aae4-4dda-a049-fe7b05f784b3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:25.795427 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0c95223-aae4-4dda-a049-fe7b05f784b3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:25.951475 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e0c95223-aae4-4dda-a049-fe7b05f784b3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:25.959970 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-433d438a-1f0c-4e06-ac37-7221bd9b9719 req-c5a2bd4b-17e2-4f76-a161-07e38518cee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a85ce7-0ab6-4543-a87c-8231bde9c4b5", "name": "network-vif-plugged", "status": "completed", "tag": "76e89343-401e-41b9-8e6d-0ed7a6b1167b"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:25.960636 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e0c95223-aae4-4dda-a049-fe7b05f784b3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:25.963483 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e0c95223-aae4-4dda-a049-fe7b05f784b3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:25.965140 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e0c95223-aae4-4dda-a049-fe7b05f784b3 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.187470 Jul 26 17:20:25.966111 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 479/898] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:25 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:25.983075 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-433d438a-1f0c-4e06-ac37-7221bd9b9719 req-c5a2bd4b-17e2-4f76-a161-07e38518cee9 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:25.983839 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-433d438a-1f0c-4e06-ac37-7221bd9b9719 req-c5a2bd4b-17e2-4f76-a161-07e38518cee9 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:25.997046 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-433d438a-1f0c-4e06-ac37-7221bd9b9719 req-c5a2bd4b-17e2-4f76-a161-07e38518cee9 service nova] Creating event network-vif-plugged:76e89343-401e-41b9-8e6d-0ed7a6b1167b for instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 on hv-cinder-83538 Jul 26 17:20:26.002996 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-433d438a-1f0c-4e06-ac37-7221bd9b9719 req-c5a2bd4b-17e2-4f76-a161-07e38518cee9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048355 Jul 26 17:20:26.003702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 420/899] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:20:26.603686 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-85cad2c0-1d90-49ae-8439-4a209c79aa65 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:26.604293 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-85cad2c0-1d90-49ae-8439-4a209c79aa65 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:26.610315 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85cad2c0-1d90-49ae-8439-4a209c79aa65 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:26.610767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85cad2c0-1d90-49ae-8439-4a209c79aa65 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:26.611561 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85cad2c0-1d90-49ae-8439-4a209c79aa65 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:26.612085 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85cad2c0-1d90-49ae-8439-4a209c79aa65 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:26.752009 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-85cad2c0-1d90-49ae-8439-4a209c79aa65 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:26.760906 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-85cad2c0-1d90-49ae-8439-4a209c79aa65 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.161064 Jul 26 17:20:26.761536 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 480/900] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:26 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:26.993146 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-95cf1766-c55e-46ef-ba53-2e53e0225669 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:26.994409 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-95cf1766-c55e-46ef-ba53-2e53e0225669 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:27.001369 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-95cf1766-c55e-46ef-ba53-2e53e0225669 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:27.001800 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-95cf1766-c55e-46ef-ba53-2e53e0225669 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:27.002566 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-95cf1766-c55e-46ef-ba53-2e53e0225669 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:27.002990 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-95cf1766-c55e-46ef-ba53-2e53e0225669 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:27.050222 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-20a9ddac-d8ab-43bd-ae0b-6e998b2d68cc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:27.050733 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-20a9ddac-d8ab-43bd-ae0b-6e998b2d68cc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:27.058681 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20a9ddac-d8ab-43bd-ae0b-6e998b2d68cc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:27.059138 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20a9ddac-d8ab-43bd-ae0b-6e998b2d68cc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:27.059919 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20a9ddac-d8ab-43bd-ae0b-6e998b2d68cc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:27.060352 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20a9ddac-d8ab-43bd-ae0b-6e998b2d68cc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:27.075624 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-20a9ddac-d8ab-43bd-ae0b-6e998b2d68cc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] HTTP exception thrown: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-20a9ddac-d8ab-43bd-ae0b-6e998b2d68cc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Request method failure captured: Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc HTTP/1.1 Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CC8XEx5Rtb0mXla7Ve2uAgbG9ZkDE9Lrp3gFHxtMJ-cnR5xJniJHbZKg3CkKepAd7xwyKfWKelAvBA9Oo2enkNrApvDbmbwv2i1jX4zlCB6g3tkP7TOvjMQJ6S_ryqrSvj0F15P14xR1ivj7qVjBzfBlPp8C5CoBlR-ipNg4QbSL4c Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 6f7fbc938d614078b719aa483aa80cd6 Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:20:27.077419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:20:27.078902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:27.078902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:27.078902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 6f7fbc938d614078b719aa483aa80cd6 Jul 26 17:20:27.078902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:27.078902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeTestJSON-329568771-project Jul 26 17:20:27.078902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:20:27.078902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:20:27.078902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: 459db7ff580948dc853b9f843700fe3c Jul 26 17:20:27.078902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeTestJSON-329568771-project Jul 26 17:20:27.078902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:20:27.078902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:27.078902 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '0bd0d4f3-4697-482a-a601-7bb08472adfc'} Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:27.079769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:27.081051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:27.082314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-20a9ddac-d8ab-43bd-ae0b-6e998b2d68cc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Returning 404 to user: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:27.082314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-20a9ddac-d8ab-43bd-ae0b-6e998b2d68cc tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 404 len: 111 microversion: 2.1 time: 0.032481 Jul 26 17:20:27.082314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 481/901] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:20:27 2022] DELETE /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 17:20:27.088091 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ca52d92a-5678-431b-b748-7893fc753e49 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:27.088702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ca52d92a-5678-431b-b748-7893fc753e49 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: 0bd0d4f3-4697-482a-a601-7bb08472adfc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:27.094921 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca52d92a-5678-431b-b748-7893fc753e49 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:27.095660 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca52d92a-5678-431b-b748-7893fc753e49 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:27.096117 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca52d92a-5678-431b-b748-7893fc753e49 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:27.096554 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca52d92a-5678-431b-b748-7893fc753e49 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:27.113851 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-ca52d92a-5678-431b-b748-7893fc753e49 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] HTTP exception thrown: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ca52d92a-5678-431b-b748-7893fc753e49 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Request method failure captured: Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc HTTP/1.1 Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CC8XEx5Rtb0mXla7Ve2uAgbG9ZkDE9Lrp3gFHxtMJ-cnR5xJniJHbZKg3CkKepAd7xwyKfWKelAvBA9Oo2enkNrApvDbmbwv2i1jX4zlCB6g3tkP7TOvjMQJ6S_ryqrSvj0F15P14xR1ivj7qVjBzfBlPp8C5CoBlR-ipNg4QbSL4c Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 6f7fbc938d614078b719aa483aa80cd6 Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:20:27.115308 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:20:27.116873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:27.116873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:27.116873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 6f7fbc938d614078b719aa483aa80cd6 Jul 26 17:20:27.116873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:27.116873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeTestJSON-329568771-project Jul 26 17:20:27.116873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:20:27.116873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:20:27.116873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: 459db7ff580948dc853b9f843700fe3c Jul 26 17:20:27.116873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeTestJSON-329568771-project Jul 26 17:20:27.116873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:20:27.116873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:27.116873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '0bd0d4f3-4697-482a-a601-7bb08472adfc'} Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:27.121934 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. Jul 26 17:20:27.123688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:27.126178 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ca52d92a-5678-431b-b748-7893fc753e49 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Returning 404 to user: Instance 0bd0d4f3-4697-482a-a601-7bb08472adfc could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:27.126178 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ca52d92a-5678-431b-b748-7893fc753e49 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc" status: 404 len: 111 microversion: 2.1 time: 0.032638 Jul 26 17:20:27.126178 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 482/902] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:27 2022] GET /compute/v2.1/servers/0bd0d4f3-4697-482a-a601-7bb08472adfc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:27.155285 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-95cf1766-c55e-46ef-ba53-2e53e0225669 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:27.164463 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-95cf1766-c55e-46ef-ba53-2e53e0225669 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:27.166587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-95cf1766-c55e-46ef-ba53-2e53e0225669 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:27.167852 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-95cf1766-c55e-46ef-ba53-2e53e0225669 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.179401 Jul 26 17:20:27.168445 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 421/903] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:26 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:27.782169 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-10c16fa6-66b3-4d21-bc53-5211540079bd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:27.782789 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-10c16fa6-66b3-4d21-bc53-5211540079bd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:27.789344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10c16fa6-66b3-4d21-bc53-5211540079bd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:27.790154 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10c16fa6-66b3-4d21-bc53-5211540079bd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:27.790842 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10c16fa6-66b3-4d21-bc53-5211540079bd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:27.791518 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10c16fa6-66b3-4d21-bc53-5211540079bd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:27.943372 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-10c16fa6-66b3-4d21-bc53-5211540079bd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:27.951191 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-10c16fa6-66b3-4d21-bc53-5211540079bd tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.172968 Jul 26 17:20:27.951753 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 483/904] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:27 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:28.192023 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-fbee5d0f-c901-4d09-ac5b-00d4512af67c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:28.192590 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-fbee5d0f-c901-4d09-ac5b-00d4512af67c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:28.199207 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fbee5d0f-c901-4d09-ac5b-00d4512af67c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:28.199658 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fbee5d0f-c901-4d09-ac5b-00d4512af67c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:28.200422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fbee5d0f-c901-4d09-ac5b-00d4512af67c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:28.200857 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fbee5d0f-c901-4d09-ac5b-00d4512af67c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:28.278641 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-27c9a81c-d238-4f9b-bc13-afa595bdd287 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:28.279196 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-27c9a81c-d238-4f9b-bc13-afa595bdd287 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:28.286004 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27c9a81c-d238-4f9b-bc13-afa595bdd287 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:28.286729 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27c9a81c-d238-4f9b-bc13-afa595bdd287 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:28.287514 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27c9a81c-d238-4f9b-bc13-afa595bdd287 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:28.288120 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27c9a81c-d238-4f9b-bc13-afa595bdd287 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:28.304182 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-27c9a81c-d238-4f9b-bc13-afa595bdd287 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] HTTP exception thrown: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-27c9a81c-d238-4f9b-bc13-afa595bdd287 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Request method failure captured: Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 HTTP/1.1 Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CC8XEx5Rtb0mXla7Ve2uAgbG9ZkDE9Lrp3gFHxtMJ-cnR5xJniJHbZKg3CkKepAd7xwyKfWKelAvBA9Oo2enkNrApvDbmbwv2i1jX4zlCB6g3tkP7TOvjMQJ6S_ryqrSvj0F15P14xR1ivj7qVjBzfBlPp8C5CoBlR-ipNg4QbSL4c Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 6f7fbc938d614078b719aa483aa80cd6 Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:20:28.305574 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:20:28.307273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:28.307273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:28.307273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 6f7fbc938d614078b719aa483aa80cd6 Jul 26 17:20:28.307273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:28.307273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeTestJSON-329568771-project Jul 26 17:20:28.307273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:20:28.307273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:20:28.307273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: 459db7ff580948dc853b9f843700fe3c Jul 26 17:20:28.307273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeTestJSON-329568771-project Jul 26 17:20:28.307273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:20:28.307273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:20:28.307273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': 'e2799ba4-de59-4849-85e7-d0aaf12578e1'} Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:28.308174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:20:28.309850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:28.311645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-27c9a81c-d238-4f9b-bc13-afa595bdd287 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Returning 404 to user: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:28.311645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-27c9a81c-d238-4f9b-bc13-afa595bdd287 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 404 len: 111 microversion: 2.1 time: 0.033533 Jul 26 17:20:28.311645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 484/905] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:20:28 2022] DELETE /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 17:20:28.320931 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-03bed583-d02c-42c7-9c82-cf44dfcbf324 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:28.323001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-03bed583-d02c-42c7-9c82-cf44dfcbf324 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] [instance: e2799ba4-de59-4849-85e7-d0aaf12578e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:28.332456 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03bed583-d02c-42c7-9c82-cf44dfcbf324 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:28.332916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03bed583-d02c-42c7-9c82-cf44dfcbf324 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:28.333926 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03bed583-d02c-42c7-9c82-cf44dfcbf324 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:28.334524 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03bed583-d02c-42c7-9c82-cf44dfcbf324 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:28.350878 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-03bed583-d02c-42c7-9c82-cf44dfcbf324 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] HTTP exception thrown: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-03bed583-d02c-42c7-9c82-cf44dfcbf324 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Request method failure captured: Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 HTTP/1.1 Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CC8XEx5Rtb0mXla7Ve2uAgbG9ZkDE9Lrp3gFHxtMJ-cnR5xJniJHbZKg3CkKepAd7xwyKfWKelAvBA9Oo2enkNrApvDbmbwv2i1jX4zlCB6g3tkP7TOvjMQJ6S_ryqrSvj0F15P14xR1ivj7qVjBzfBlPp8C5CoBlR-ipNg4QbSL4c Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 6f7fbc938d614078b719aa483aa80cd6 Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:20:28.354331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:20:28.355920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f7fbc938d614078b719aa483aa80cd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:28.355920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:28.355920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 6f7fbc938d614078b719aa483aa80cd6 Jul 26 17:20:28.355920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeTestJSON-329568771 Jul 26 17:20:28.355920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeTestJSON-329568771-project Jul 26 17:20:28.355920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:20:28.355920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:20:28.355920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: 459db7ff580948dc853b9f843700fe3c Jul 26 17:20:28.355920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeTestJSON-329568771-project Jul 26 17:20:28.355920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:20:28.355920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:20:28.355920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': 'e2799ba4-de59-4849-85e7-d0aaf12578e1'} Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:28.356831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. Jul 26 17:20:28.358306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:28.363049 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-03bed583-d02c-42c7-9c82-cf44dfcbf324 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] Returning 404 to user: Instance e2799ba4-de59-4849-85e7-d0aaf12578e1 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:28.364097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-03bed583-d02c-42c7-9c82-cf44dfcbf324 tempest-AttachVolumeTestJSON-329568771 tempest-AttachVolumeTestJSON-329568771-project] 10.222.0.48 "GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1" status: 404 len: 111 microversion: 2.1 time: 0.046951 Jul 26 17:20:28.370415 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 485/906] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:28 2022] GET /compute/v2.1/servers/e2799ba4-de59-4849-85e7-d0aaf12578e1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:28.385431 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-fbee5d0f-c901-4d09-ac5b-00d4512af67c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:28.396771 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-fbee5d0f-c901-4d09-ac5b-00d4512af67c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:28.399106 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-fbee5d0f-c901-4d09-ac5b-00d4512af67c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:28.400917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-fbee5d0f-c901-4d09-ac5b-00d4512af67c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1732 microversion: 2.20 time: 0.212950 Jul 26 17:20:28.401839 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 422/907] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:28 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1732 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:20:28.974460 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bd61629c-9f63-4acd-8815-075294fde190 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:28.975240 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bd61629c-9f63-4acd-8815-075294fde190 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:28.984153 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd61629c-9f63-4acd-8815-075294fde190 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:28.984521 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd61629c-9f63-4acd-8815-075294fde190 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:28.985413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd61629c-9f63-4acd-8815-075294fde190 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:28.986135 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd61629c-9f63-4acd-8815-075294fde190 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:29.229780 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bd61629c-9f63-4acd-8815-075294fde190 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:29.241026 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bd61629c-9f63-4acd-8815-075294fde190 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.270723 Jul 26 17:20:29.241955 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 486/908] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:28 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:29.427464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-eaedbf55-6139-4d50-9b16-857c0f7a689f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:29.428153 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-eaedbf55-6139-4d50-9b16-857c0f7a689f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:29.435936 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-eaedbf55-6139-4d50-9b16-857c0f7a689f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:29.436614 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-eaedbf55-6139-4d50-9b16-857c0f7a689f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:29.437791 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-eaedbf55-6139-4d50-9b16-857c0f7a689f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:29.438478 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-eaedbf55-6139-4d50-9b16-857c0f7a689f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:29.600308 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-eaedbf55-6139-4d50-9b16-857c0f7a689f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:29.610544 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-eaedbf55-6139-4d50-9b16-857c0f7a689f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:29.612153 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-eaedbf55-6139-4d50-9b16-857c0f7a689f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:29.613881 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-eaedbf55-6139-4d50-9b16-857c0f7a689f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1719 microversion: 2.20 time: 0.190085 Jul 26 17:20:29.614937 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 423/909] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:20:29 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1719 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:20:29.655564 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-522b28a4-4be5-4878-893f-280f5318b136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:29.656155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-522b28a4-4be5-4878-893f-280f5318b136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:29.662910 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-522b28a4-4be5-4878-893f-280f5318b136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:29.663419 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-522b28a4-4be5-4878-893f-280f5318b136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:29.664205 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-522b28a4-4be5-4878-893f-280f5318b136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:29.664637 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-522b28a4-4be5-4878-893f-280f5318b136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:29.756028 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-522b28a4-4be5-4878-893f-280f5318b136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lazy-loading 'services' on Instance uuid f8a382f9-1c88-4f2c-8692-d03bd154459b {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:20:29.831477 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-522b28a4-4be5-4878-893f-280f5318b136 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/os-volume_attachments/48ccc540-de11-47bb-a2f1-8e0648b13019" status: 202 len: 0 microversion: 2.1 time: 0.179696 Jul 26 17:20:29.832063 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 487/910] 10.222.0.48 () {58 vars in 1416 bytes} [Tue Jul 26 17:20:29 2022] DELETE /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/os-volume_attachments/48ccc540-de11-47bb-a2f1-8e0648b13019 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:20:29.841267 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9867b347-f8cf-4dd3-828b-bb37d89927b5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:29.843731 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9867b347-f8cf-4dd3-828b-bb37d89927b5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:29.849986 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9867b347-f8cf-4dd3-828b-bb37d89927b5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:29.850746 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9867b347-f8cf-4dd3-828b-bb37d89927b5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:29.851667 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9867b347-f8cf-4dd3-828b-bb37d89927b5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:29.852239 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9867b347-f8cf-4dd3-828b-bb37d89927b5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:29.889312 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9867b347-f8cf-4dd3-828b-bb37d89927b5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052809 Jul 26 17:20:29.890675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 424/911] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:20:29 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:20:30.265688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3f68ee7a-3a43-43b9-9ceb-42f42cd4a364 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:30.266852 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3f68ee7a-3a43-43b9-9ceb-42f42cd4a364 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:30.273571 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f68ee7a-3a43-43b9-9ceb-42f42cd4a364 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:30.274622 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f68ee7a-3a43-43b9-9ceb-42f42cd4a364 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:30.276153 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f68ee7a-3a43-43b9-9ceb-42f42cd4a364 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:30.276592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f68ee7a-3a43-43b9-9ceb-42f42cd4a364 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:30.458770 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3f68ee7a-3a43-43b9-9ceb-42f42cd4a364 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:30.467790 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3f68ee7a-3a43-43b9-9ceb-42f42cd4a364 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.206951 Jul 26 17:20:30.468665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 488/912] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:30 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:30.904270 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-fb5dd026-8bf2-44f4-97b9-e78ffaf52343 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:30.907843 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-fb5dd026-8bf2-44f4-97b9-e78ffaf52343 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:30.916477 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fb5dd026-8bf2-44f4-97b9-e78ffaf52343 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:30.917409 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fb5dd026-8bf2-44f4-97b9-e78ffaf52343 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:30.918423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fb5dd026-8bf2-44f4-97b9-e78ffaf52343 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:30.919079 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fb5dd026-8bf2-44f4-97b9-e78ffaf52343 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:30.960461 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-fb5dd026-8bf2-44f4-97b9-e78ffaf52343 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062089 Jul 26 17:20:30.961421 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 425/913] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:20:30 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:20:31.491773 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7728f86d-24ef-45a5-ad6f-33652bf21e6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:31.492565 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7728f86d-24ef-45a5-ad6f-33652bf21e6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:31.499976 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7728f86d-24ef-45a5-ad6f-33652bf21e6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:31.500516 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7728f86d-24ef-45a5-ad6f-33652bf21e6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:31.501327 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7728f86d-24ef-45a5-ad6f-33652bf21e6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:31.501754 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7728f86d-24ef-45a5-ad6f-33652bf21e6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:31.520563 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:31.707747 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7728f86d-24ef-45a5-ad6f-33652bf21e6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:31.716383 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7728f86d-24ef-45a5-ad6f-33652bf21e6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.229990 Jul 26 17:20:31.717123 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 489/914] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:31 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:31.974700 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1af5ee8a-4be8-4cc3-9574-76674599bf94 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:31.976851 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1af5ee8a-4be8-4cc3-9574-76674599bf94 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:31.986995 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1af5ee8a-4be8-4cc3-9574-76674599bf94 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:31.987827 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1af5ee8a-4be8-4cc3-9574-76674599bf94 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:32.002659 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1af5ee8a-4be8-4cc3-9574-76674599bf94 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:32.003632 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1af5ee8a-4be8-4cc3-9574-76674599bf94 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:32.039510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1af5ee8a-4be8-4cc3-9574-76674599bf94 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068860 Jul 26 17:20:32.065405 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 426/915] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:20:31 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 17:20:32.166471 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-86862d5b-a6b4-401c-8b0a-143862d8a0a3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:32.166973 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-86862d5b-a6b4-401c-8b0a-143862d8a0a3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:32.193642 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86862d5b-a6b4-401c-8b0a-143862d8a0a3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:32.194111 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86862d5b-a6b4-401c-8b0a-143862d8a0a3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:32.194937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86862d5b-a6b4-401c-8b0a-143862d8a0a3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:32.195383 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86862d5b-a6b4-401c-8b0a-143862d8a0a3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:32.231871 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-86862d5b-a6b4-401c-8b0a-143862d8a0a3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:20:32.355650 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-86862d5b-a6b4-401c-8b0a-143862d8a0a3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 204 len: 0 microversion: 2.1 time: 0.192496 Jul 26 17:20:32.359992 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 490/916] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:20:32 2022] DELETE /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:20:32.366609 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6a570cfd-2622-4e87-9b45-63add863b848 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:32.369031 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6a570cfd-2622-4e87-9b45-63add863b848 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:32.378255 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6a570cfd-2622-4e87-9b45-63add863b848 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:32.380778 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6a570cfd-2622-4e87-9b45-63add863b848 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:32.381908 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6a570cfd-2622-4e87-9b45-63add863b848 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:32.382607 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6a570cfd-2622-4e87-9b45-63add863b848 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:32.596077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6a570cfd-2622-4e87-9b45-63add863b848 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:32.607009 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6a570cfd-2622-4e87-9b45-63add863b848 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1679 microversion: 2.1 time: 0.245336 Jul 26 17:20:32.609469 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 427/917] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:32 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:32.741055 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-47ec455a-78a5-4930-9dad-802fee242685 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:32.741904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-47ec455a-78a5-4930-9dad-802fee242685 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:32.749124 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47ec455a-78a5-4930-9dad-802fee242685 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:32.749568 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47ec455a-78a5-4930-9dad-802fee242685 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:32.750360 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47ec455a-78a5-4930-9dad-802fee242685 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:32.750797 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47ec455a-78a5-4930-9dad-802fee242685 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:32.940683 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-47ec455a-78a5-4930-9dad-802fee242685 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:32.950122 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-47ec455a-78a5-4930-9dad-802fee242685 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.213850 Jul 26 17:20:32.950707 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 491/918] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:32 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:33.630543 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0b4b73b8-7709-4031-9bc0-05f5bf41469a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:33.631265 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0b4b73b8-7709-4031-9bc0-05f5bf41469a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:33.638370 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0b4b73b8-7709-4031-9bc0-05f5bf41469a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:33.638904 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0b4b73b8-7709-4031-9bc0-05f5bf41469a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:33.639752 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0b4b73b8-7709-4031-9bc0-05f5bf41469a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:33.640280 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0b4b73b8-7709-4031-9bc0-05f5bf41469a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:33.772121 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0b4b73b8-7709-4031-9bc0-05f5bf41469a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:33.781196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0b4b73b8-7709-4031-9bc0-05f5bf41469a tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1679 microversion: 2.1 time: 0.154374 Jul 26 17:20:33.781892 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 428/919] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:33 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:33.971440 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6285b275-dd8f-429d-9209-c8470799ed6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:33.972050 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6285b275-dd8f-429d-9209-c8470799ed6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:33.978817 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6285b275-dd8f-429d-9209-c8470799ed6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:33.979351 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6285b275-dd8f-429d-9209-c8470799ed6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:33.980078 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6285b275-dd8f-429d-9209-c8470799ed6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:33.980490 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6285b275-dd8f-429d-9209-c8470799ed6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:34.127040 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6285b275-dd8f-429d-9209-c8470799ed6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:34.135887 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6285b275-dd8f-429d-9209-c8470799ed6d tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.168186 Jul 26 17:20:34.136456 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 492/920] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:33 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:34.805029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-50ada437-a14b-475e-a39d-7a37c1532242 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:34.807217 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-50ada437-a14b-475e-a39d-7a37c1532242 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:34.814962 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-50ada437-a14b-475e-a39d-7a37c1532242 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:34.815415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-50ada437-a14b-475e-a39d-7a37c1532242 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:34.816191 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-50ada437-a14b-475e-a39d-7a37c1532242 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:34.816628 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-50ada437-a14b-475e-a39d-7a37c1532242 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:34.823234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=100 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:35.006835 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-50ada437-a14b-475e-a39d-7a37c1532242 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:35.015117 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-50ada437-a14b-475e-a39d-7a37c1532242 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1679 microversion: 2.1 time: 0.215467 Jul 26 17:20:35.015690 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 429/921] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:34 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:35.156743 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f164c238-5b8c-47cd-b3c5-5db21033baf3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:35.157430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f164c238-5b8c-47cd-b3c5-5db21033baf3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:35.164236 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f164c238-5b8c-47cd-b3c5-5db21033baf3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:35.164724 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f164c238-5b8c-47cd-b3c5-5db21033baf3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:35.165528 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f164c238-5b8c-47cd-b3c5-5db21033baf3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:35.165953 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f164c238-5b8c-47cd-b3c5-5db21033baf3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:35.411264 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f164c238-5b8c-47cd-b3c5-5db21033baf3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:35.419073 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f164c238-5b8c-47cd-b3c5-5db21033baf3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1569 microversion: 2.1 time: 0.266143 Jul 26 17:20:35.419710 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 493/922] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:35 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1569 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:20:35.440757 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1bed4ce9-3e47-42bd-af38-43654c490ebe tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:35.441376 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1bed4ce9-3e47-42bd-af38-43654c490ebe tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:35.447472 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bed4ce9-3e47-42bd-af38-43654c490ebe tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:35.447923 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bed4ce9-3e47-42bd-af38-43654c490ebe tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:35.448691 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bed4ce9-3e47-42bd-af38-43654c490ebe tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:35.449157 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bed4ce9-3e47-42bd-af38-43654c490ebe tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:35.527414 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1bed4ce9-3e47-42bd-af38-43654c490ebe tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "POST /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6/action" status: 202 len: 0 microversion: 2.1 time: 0.090322 Jul 26 17:20:35.531887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 430/923] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:20:35 2022] POST /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 17:20:35.538570 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aa992ec4-66d8-49ee-8854-421b06479ba1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:35.538937 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aa992ec4-66d8-49ee-8854-421b06479ba1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:35.546300 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa992ec4-66d8-49ee-8854-421b06479ba1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:35.547137 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa992ec4-66d8-49ee-8854-421b06479ba1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:35.548149 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa992ec4-66d8-49ee-8854-421b06479ba1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:35.549079 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa992ec4-66d8-49ee-8854-421b06479ba1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:35.646814 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-fe76b76b-a385-4fea-adb7-bc5614c58d75 req-325a2bfa-046d-4b48-b933-4ca1a575e87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a382f9-1c88-4f2c-8692-d03bd154459b", "name": "network-vif-deleted", "tag": "774e109c-da42-4dc8-9225-464228f56582"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:35.663890 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-fe76b76b-a385-4fea-adb7-bc5614c58d75 req-325a2bfa-046d-4b48-b933-4ca1a575e87e service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:35.667118 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-fe76b76b-a385-4fea-adb7-bc5614c58d75 req-325a2bfa-046d-4b48-b933-4ca1a575e87e service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:35.692983 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-fe76b76b-a385-4fea-adb7-bc5614c58d75 req-325a2bfa-046d-4b48-b933-4ca1a575e87e service nova] Creating event network-vif-deleted:774e109c-da42-4dc8-9225-464228f56582 for instance f8a382f9-1c88-4f2c-8692-d03bd154459b on hv-cinder-83538 Jul 26 17:20:35.706029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-fe76b76b-a385-4fea-adb7-bc5614c58d75 req-325a2bfa-046d-4b48-b933-4ca1a575e87e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062363 Jul 26 17:20:35.708277 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 431/924] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:20:35.811462 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-aa992ec4-66d8-49ee-8854-421b06479ba1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:35.820366 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aa992ec4-66d8-49ee-8854-421b06479ba1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1577 microversion: 2.1 time: 0.287031 Jul 26 17:20:35.821521 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 494/925] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:35 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1577 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:36.041787 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e1bb22e2-fea1-42a9-ac8e-cc35678e81f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:36.043470 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-e1bb22e2-fea1-42a9-ac8e-cc35678e81f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:36.050983 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e1bb22e2-fea1-42a9-ac8e-cc35678e81f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:36.051675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e1bb22e2-fea1-42a9-ac8e-cc35678e81f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:36.053230 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e1bb22e2-fea1-42a9-ac8e-cc35678e81f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:36.054123 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e1bb22e2-fea1-42a9-ac8e-cc35678e81f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:36.141682 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e1bb22e2-fea1-42a9-ac8e-cc35678e81f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:36.149729 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e1bb22e2-fea1-42a9-ac8e-cc35678e81f5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1612 microversion: 2.1 time: 0.115434 Jul 26 17:20:36.150763 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 432/926] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:36 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1612 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:36.841354 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3ad36e1e-fe8c-4a4c-b88d-ad58fd4b0196 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:36.841952 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3ad36e1e-fe8c-4a4c-b88d-ad58fd4b0196 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:36.848354 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad36e1e-fe8c-4a4c-b88d-ad58fd4b0196 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:36.848799 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad36e1e-fe8c-4a4c-b88d-ad58fd4b0196 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:36.849591 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad36e1e-fe8c-4a4c-b88d-ad58fd4b0196 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:36.850027 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad36e1e-fe8c-4a4c-b88d-ad58fd4b0196 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:36.983215 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3ad36e1e-fe8c-4a4c-b88d-ad58fd4b0196 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:36.990897 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3ad36e1e-fe8c-4a4c-b88d-ad58fd4b0196 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1517 microversion: 2.1 time: 0.153404 Jul 26 17:20:36.991468 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 495/927] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:36 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:37.171772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-998af386-d8bf-460f-9264-cf6155fa0fe3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:37.173129 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-998af386-d8bf-460f-9264-cf6155fa0fe3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:37.180207 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-998af386-d8bf-460f-9264-cf6155fa0fe3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:37.181048 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-998af386-d8bf-460f-9264-cf6155fa0fe3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:37.182064 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-998af386-d8bf-460f-9264-cf6155fa0fe3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:37.182797 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-998af386-d8bf-460f-9264-cf6155fa0fe3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:37.215824 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-998af386-d8bf-460f-9264-cf6155fa0fe3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:37.216379 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-998af386-d8bf-460f-9264-cf6155fa0fe3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:37.216901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.objects.instance [None req-998af386-d8bf-460f-9264-cf6155fa0fe3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lazy-loading 'fault' on Instance uuid f8a382f9-1c88-4f2c-8692-d03bd154459b {{(pid=118122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:20:37.226249 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-e41b5cb5-a420-4271-a565-75e1638bc30f req-e24fd451-c319-43e4-905e-5f4346396248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b93f34-9005-40dc-acb1-496c1eaf53c6", "name": "network-vif-unplugged", "status": "completed", "tag": "106ac6cf-a172-4113-980c-418b8d51f6a4"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:37.243204 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e41b5cb5-a420-4271-a565-75e1638bc30f req-e24fd451-c319-43e4-905e-5f4346396248 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:37.243976 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e41b5cb5-a420-4271-a565-75e1638bc30f req-e24fd451-c319-43e4-905e-5f4346396248 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:37.260009 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.compute.server_external_events [req-e41b5cb5-a420-4271-a565-75e1638bc30f req-e24fd451-c319-43e4-905e-5f4346396248 service nova] Unable to find a host for instance 95b93f34-9005-40dc-acb1-496c1eaf53c6. Dropping event network-vif-unplugged {{(pid=118121) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 17:20:37.261041 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-e41b5cb5-a420-4271-a565-75e1638bc30f req-e24fd451-c319-43e4-905e-5f4346396248 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039015 Jul 26 17:20:37.262037 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 496/928] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 26 17:20:37.288116 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-998af386-d8bf-460f-9264-cf6155fa0fe3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6291932ceb84b03924c0f056f29c2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446eaae0a4f34eba86d4b0de0c2d1013', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:37.297040 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-998af386-d8bf-460f-9264-cf6155fa0fe3 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 200 len: 1331 microversion: 2.1 time: 0.129046 Jul 26 17:20:37.298331 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 433/929] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:37 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:37.891337 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-29594a5c-2205-4c19-8d13-24d1b091284d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:37.892186 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-29594a5c-2205-4c19-8d13-24d1b091284d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:37.898658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29594a5c-2205-4c19-8d13-24d1b091284d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:37.899107 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29594a5c-2205-4c19-8d13-24d1b091284d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:37.899872 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29594a5c-2205-4c19-8d13-24d1b091284d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:37.900911 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29594a5c-2205-4c19-8d13-24d1b091284d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:37.927157 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-29594a5c-2205-4c19-8d13-24d1b091284d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:20:38.008664 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-29594a5c-2205-4c19-8d13-24d1b091284d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "DELETE /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 204 len: 0 microversion: 2.1 time: 0.120742 Jul 26 17:20:38.012719 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 497/930] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:20:37 2022] DELETE /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:20:38.012870 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ac301b50-5e17-427e-8679-ab62a352044b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:38.012870 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ac301b50-5e17-427e-8679-ab62a352044b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:38.018387 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8a9afea4-b567-4d1c-95d2-f4df7ff51141 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:38.019089 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8a9afea4-b567-4d1c-95d2-f4df7ff51141 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:38.019235 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ac301b50-5e17-427e-8679-ab62a352044b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:38.019568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ac301b50-5e17-427e-8679-ab62a352044b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:38.020331 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ac301b50-5e17-427e-8679-ab62a352044b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:38.020789 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ac301b50-5e17-427e-8679-ab62a352044b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:38.025051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a9afea4-b567-4d1c-95d2-f4df7ff51141 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:38.025590 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a9afea4-b567-4d1c-95d2-f4df7ff51141 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:38.026378 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a9afea4-b567-4d1c-95d2-f4df7ff51141 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:38.026819 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a9afea4-b567-4d1c-95d2-f4df7ff51141 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:38.161137 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ac301b50-5e17-427e-8679-ab62a352044b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:38.170658 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ac301b50-5e17-427e-8679-ab62a352044b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1519 microversion: 2.1 time: 0.162421 Jul 26 17:20:38.171600 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 434/931] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:38 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:20:38.173896 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8a9afea4-b567-4d1c-95d2-f4df7ff51141 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:38.182272 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8a9afea4-b567-4d1c-95d2-f4df7ff51141 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1579 microversion: 2.1 time: 0.167538 Jul 26 17:20:38.191100 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 498/932] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:38 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:38.318545 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3d51f4af-5c06-4a3e-9b75-13079524dd42 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:38.319163 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3d51f4af-5c06-4a3e-9b75-13079524dd42 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:38.326161 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3d51f4af-5c06-4a3e-9b75-13079524dd42 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:38.326598 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3d51f4af-5c06-4a3e-9b75-13079524dd42 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:38.327626 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3d51f4af-5c06-4a3e-9b75-13079524dd42 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:38.328062 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3d51f4af-5c06-4a3e-9b75-13079524dd42 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:38.342520 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-3d51f4af-5c06-4a3e-9b75-13079524dd42 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3d51f4af-5c06-4a3e-9b75-13079524dd42 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b HTTP/1.1 Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:20:38.344165 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:20:38.345552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:38.345552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:38.345552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:38.345552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:38.345552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:38.345552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:20:38.345552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:20:38.345552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:20:38.345552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:38.345552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:20:38.345552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:38.345552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': 'f8a382f9-1c88-4f2c-8692-d03bd154459b'} Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:38.346303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:38.347471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:38.348624 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3d51f4af-5c06-4a3e-9b75-13079524dd42 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 404 to user: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:38.348624 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3d51f4af-5c06-4a3e-9b75-13079524dd42 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 404 len: 111 microversion: 2.1 time: 0.031119 Jul 26 17:20:38.348624 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 435/933] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:38 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:38.356182 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bf66f393-1f35-45ef-992e-5d23851723af tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '.version_select at 0x7f6ca899fb80>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:38.376084 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bf66f393-1f35-45ef-992e-5d23851723af tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857666756" status: 202 len: 0 microversion: 2.1 time: 0.025079 Jul 26 17:20:38.376741 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 499/934] 10.222.0.48 () {58 vars in 1221 bytes} [Tue Jul 26 17:20:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857666756 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:20:39.192381 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-5ed4dc77-a421-4122-9f25-2cff323550d3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:39.193009 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-5ed4dc77-a421-4122-9f25-2cff323550d3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:39.200020 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5ed4dc77-a421-4122-9f25-2cff323550d3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:39.200661 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5ed4dc77-a421-4122-9f25-2cff323550d3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:39.201624 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5ed4dc77-a421-4122-9f25-2cff323550d3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:39.202055 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-5ed4dc77-a421-4122-9f25-2cff323550d3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:39.205863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2670ac6f-f62c-422c-a486-732a04c881ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:39.206782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2670ac6f-f62c-422c-a486-732a04c881ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:39.225793 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2670ac6f-f62c-422c-a486-732a04c881ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:39.226436 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2670ac6f-f62c-422c-a486-732a04c881ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:39.227305 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2670ac6f-f62c-422c-a486-732a04c881ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:39.227812 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2670ac6f-f62c-422c-a486-732a04c881ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:39.367553 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-5ed4dc77-a421-4122-9f25-2cff323550d3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:39.375817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-5ed4dc77-a421-4122-9f25-2cff323550d3 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1519 microversion: 2.1 time: 0.187307 Jul 26 17:20:39.376391 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 436/935] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:39 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:39.387002 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2670ac6f-f62c-422c-a486-732a04c881ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:39.394925 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2670ac6f-f62c-422c-a486-732a04c881ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1579 microversion: 2.1 time: 0.194513 Jul 26 17:20:39.395500 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 500/936] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:39 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1579 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:40.321232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ad13ebf5-854c-49d1-a799-3ff6e3814c5e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:40.321711 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ad13ebf5-854c-49d1-a799-3ff6e3814c5e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:40.329898 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ad13ebf5-854c-49d1-a799-3ff6e3814c5e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:40.330355 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ad13ebf5-854c-49d1-a799-3ff6e3814c5e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:40.331255 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ad13ebf5-854c-49d1-a799-3ff6e3814c5e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:40.331692 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ad13ebf5-854c-49d1-a799-3ff6e3814c5e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:40.349909 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-ad13ebf5-854c-49d1-a799-3ff6e3814c5e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ad13ebf5-854c-49d1-a799-3ff6e3814c5e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: DELETE /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b HTTP/1.1 Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:20:40.351528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:20:40.352929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:40.352929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:40.352929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:40.352929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:40.352929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:40.352929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:20:40.352929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:20:40.352929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:20:40.352929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:40.352929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:20:40.352929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:40.352929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': 'f8a382f9-1c88-4f2c-8692-d03bd154459b'} Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:40.354981 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:40.356222 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:40.357548 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ad13ebf5-854c-49d1-a799-3ff6e3814c5e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 404 to user: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:40.357548 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ad13ebf5-854c-49d1-a799-3ff6e3814c5e tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 404 len: 111 microversion: 2.1 time: 0.038720 Jul 26 17:20:40.357548 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 437/937] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:20:40 2022] DELETE /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:40.363561 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-86458740-5f7a-4126-a557-aed60c6ace95 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:40.364169 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-86458740-5f7a-4126-a557-aed60c6ace95 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: f8a382f9-1c88-4f2c-8692-d03bd154459b] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:40.372084 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86458740-5f7a-4126-a557-aed60c6ace95 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:40.372634 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86458740-5f7a-4126-a557-aed60c6ace95 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:40.373957 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86458740-5f7a-4126-a557-aed60c6ace95 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:40.374412 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86458740-5f7a-4126-a557-aed60c6ace95 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:40.392859 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-86458740-5f7a-4126-a557-aed60c6ace95 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-86458740-5f7a-4126-a557-aed60c6ace95 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b HTTP/1.1 Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:20:40.394882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:20:40.396306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:40.396306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:40.396306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:40.396306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:40.396306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:40.396306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:20:40.396306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:20:40.396306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:20:40.396306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:40.396306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:20:40.396306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:40.396306 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': 'f8a382f9-1c88-4f2c-8692-d03bd154459b'} Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:40.401375 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. Jul 26 17:20:40.402631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:40.403809 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-86458740-5f7a-4126-a557-aed60c6ace95 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 404 to user: Instance f8a382f9-1c88-4f2c-8692-d03bd154459b could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:40.403809 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-86458740-5f7a-4126-a557-aed60c6ace95 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b" status: 404 len: 111 microversion: 2.1 time: 0.037324 Jul 26 17:20:40.405358 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 501/938] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:40 2022] GET /compute/v2.1/servers/f8a382f9-1c88-4f2c-8692-d03bd154459b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:40.410438 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-91f7f717-54c3-474d-a26a-fb8146d15f3a tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:40.410438 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-91f7f717-54c3-474d-a26a-fb8146d15f3a tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:40.418339 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-91f7f717-54c3-474d-a26a-fb8146d15f3a tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:40.418789 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-91f7f717-54c3-474d-a26a-fb8146d15f3a tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:40.419158 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-261f3333-40fe-41bd-b987-e68baaf00da9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:40.419555 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-91f7f717-54c3-474d-a26a-fb8146d15f3a tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:40.419771 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-261f3333-40fe-41bd-b987-e68baaf00da9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:40.419987 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-91f7f717-54c3-474d-a26a-fb8146d15f3a tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:40.434557 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-261f3333-40fe-41bd-b987-e68baaf00da9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:40.435005 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-261f3333-40fe-41bd-b987-e68baaf00da9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:40.436002 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-261f3333-40fe-41bd-b987-e68baaf00da9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:40.436730 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-261f3333-40fe-41bd-b987-e68baaf00da9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:40.615511 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-261f3333-40fe-41bd-b987-e68baaf00da9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:40.625130 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-261f3333-40fe-41bd-b987-e68baaf00da9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1579 microversion: 2.1 time: 0.210450 Jul 26 17:20:40.627911 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 502/939] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:40 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1579 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:40.642598 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-91f7f717-54c3-474d-a26a-fb8146d15f3a tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:40.663802 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-91f7f717-54c3-474d-a26a-fb8146d15f3a tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.257731 Jul 26 17:20:40.664467 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 438/940] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:40 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:41.606098 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-147bb14e-732f-4d68-8440-d5e3a6fb7dcb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:41.606666 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-147bb14e-732f-4d68-8440-d5e3a6fb7dcb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:41.614221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-147bb14e-732f-4d68-8440-d5e3a6fb7dcb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:41.614757 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-147bb14e-732f-4d68-8440-d5e3a6fb7dcb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:41.615764 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-147bb14e-732f-4d68-8440-d5e3a6fb7dcb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:41.616400 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-147bb14e-732f-4d68-8440-d5e3a6fb7dcb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:41.632633 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-147bb14e-732f-4d68-8440-d5e3a6fb7dcb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-147bb14e-732f-4d68-8440-d5e3a6fb7dcb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb HTTP/1.1 Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:20:41.634365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:20:41.640311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:41.640311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:41.640311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:41.640311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:41.640311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:41.640311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:20:41.640311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:20:41.640311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:20:41.640311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:41.640311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:20:41.640311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:20:41.640311 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '8c1e9557-fc15-4ea5-9b93-de135b76dfeb'} Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:41.641541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:20:41.642761 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.643968 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-147bb14e-732f-4d68-8440-d5e3a6fb7dcb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 404 to user: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:41.643968 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-147bb14e-732f-4d68-8440-d5e3a6fb7dcb tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 404 len: 111 microversion: 2.1 time: 0.034475 Jul 26 17:20:41.643968 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 503/941] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:20:41 2022] DELETE /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:41.650933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7b344d4d-cc23-421e-b02c-4da12d0542d5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:41.651564 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7b344d4d-cc23-421e-b02c-4da12d0542d5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:41.651782 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f6c723cd-3310-4fa0-8349-edff74e76539 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:41.652978 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-f6c723cd-3310-4fa0-8349-edff74e76539 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 8c1e9557-fc15-4ea5-9b93-de135b76dfeb] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:41.657835 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b344d4d-cc23-421e-b02c-4da12d0542d5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:41.658352 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b344d4d-cc23-421e-b02c-4da12d0542d5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:41.660065 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b344d4d-cc23-421e-b02c-4da12d0542d5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:41.660515 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b344d4d-cc23-421e-b02c-4da12d0542d5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:41.662072 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f6c723cd-3310-4fa0-8349-edff74e76539 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:41.662780 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f6c723cd-3310-4fa0-8349-edff74e76539 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:41.664073 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f6c723cd-3310-4fa0-8349-edff74e76539 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:41.666596 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f6c723cd-3310-4fa0-8349-edff74e76539 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:41.684615 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-f6c723cd-3310-4fa0-8349-edff74e76539 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f6c723cd-3310-4fa0-8349-edff74e76539 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb HTTP/1.1 Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:20:41.686774 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:20:41.688396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:41.688396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:41.688396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:41.688396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:41.688396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:41.688396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:20:41.688396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:20:41.688396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:20:41.688396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:41.688396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:20:41.688396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:20:41.688396 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '8c1e9557-fc15-4ea5-9b93-de135b76dfeb'} Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:41.689340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. Jul 26 17:20:41.690806 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.692094 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f6c723cd-3310-4fa0-8349-edff74e76539 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 404 to user: Instance 8c1e9557-fc15-4ea5-9b93-de135b76dfeb could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:41.692094 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-f6c723cd-3310-4fa0-8349-edff74e76539 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb" status: 404 len: 111 microversion: 2.1 time: 0.043392 Jul 26 17:20:41.692094 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 439/942] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:41 2022] GET /compute/v2.1/servers/8c1e9557-fc15-4ea5-9b93-de135b76dfeb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:41.705038 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9eedb4c0-6d92-4b07-b6c3-bd6b476b04e7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:41.705038 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9eedb4c0-6d92-4b07-b6c3-bd6b476b04e7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:41.709091 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9eedb4c0-6d92-4b07-b6c3-bd6b476b04e7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:41.709091 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9eedb4c0-6d92-4b07-b6c3-bd6b476b04e7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:41.713488 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9eedb4c0-6d92-4b07-b6c3-bd6b476b04e7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:41.713965 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9eedb4c0-6d92-4b07-b6c3-bd6b476b04e7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:41.867460 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9eedb4c0-6d92-4b07-b6c3-bd6b476b04e7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:41.876687 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9eedb4c0-6d92-4b07-b6c3-bd6b476b04e7 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.180605 Jul 26 17:20:41.877256 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 440/943] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:41 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:41.886202 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0bcc00e3-0954-4eb6-8b53-30c51c790704 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:41.887343 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0bcc00e3-0954-4eb6-8b53-30c51c790704 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:41.893647 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0bcc00e3-0954-4eb6-8b53-30c51c790704 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:41.894095 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0bcc00e3-0954-4eb6-8b53-30c51c790704 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:41.894866 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0bcc00e3-0954-4eb6-8b53-30c51c790704 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:41.895385 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0bcc00e3-0954-4eb6-8b53-30c51c790704 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:41.910580 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-0bcc00e3-0954-4eb6-8b53-30c51c790704 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0bcc00e3-0954-4eb6-8b53-30c51c790704 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: DELETE /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 HTTP/1.1 Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:20:41.912113 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:20:41.913795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:41.913795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:41.913795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:41.913795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:41.913795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:41.913795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:20:41.913795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:20:41.913795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:20:41.913795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:41.913795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:20:41.913795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:20:41.913795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': 'db19722e-e060-4323-8b57-179687e601d6'} Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:41.914631 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:20:41.916356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.917945 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0bcc00e3-0954-4eb6-8b53-30c51c790704 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 404 to user: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:41.917945 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0bcc00e3-0954-4eb6-8b53-30c51c790704 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 404 len: 111 microversion: 2.1 time: 0.035420 Jul 26 17:20:41.917945 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 441/944] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:20:41 2022] DELETE /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:41.923046 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-357a03a9-d028-4427-ace9-1914fd86c880 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:41.923639 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-357a03a9-d028-4427-ace9-1914fd86c880 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: db19722e-e060-4323-8b57-179687e601d6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:41.930832 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-357a03a9-d028-4427-ace9-1914fd86c880 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:41.932006 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-357a03a9-d028-4427-ace9-1914fd86c880 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:41.932621 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-357a03a9-d028-4427-ace9-1914fd86c880 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:41.933085 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-357a03a9-d028-4427-ace9-1914fd86c880 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:41.961341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-357a03a9-d028-4427-ace9-1914fd86c880 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-357a03a9-d028-4427-ace9-1914fd86c880 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 HTTP/1.1 Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:20:41.963232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:20:41.964808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:41.964808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:41.964808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:41.964808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:41.964808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:41.964808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:20:41.964808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:20:41.964808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:20:41.964808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:41.964808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:20:41.964808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:20:41.964808 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': 'db19722e-e060-4323-8b57-179687e601d6'} Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:41.965969 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. Jul 26 17:20:41.967552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:41.970190 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7b344d4d-cc23-421e-b02c-4da12d0542d5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:41.973632 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-357a03a9-d028-4427-ace9-1914fd86c880 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 404 to user: Instance db19722e-e060-4323-8b57-179687e601d6 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:41.975278 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-357a03a9-d028-4427-ace9-1914fd86c880 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6" status: 404 len: 111 microversion: 2.1 time: 0.055867 Jul 26 17:20:41.976496 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 442/945] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:41 2022] GET /compute/v2.1/servers/db19722e-e060-4323-8b57-179687e601d6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:41.979893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7b344d4d-cc23-421e-b02c-4da12d0542d5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1579 microversion: 2.1 time: 0.333690 Jul 26 17:20:41.980720 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 504/946] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:41 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1579 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:42.385743 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-4997db92-bf1c-4d34-92f1-1c30ab92ae25 req-d52dcc82-d362-4145-962f-e3f8697f89a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba8d6de-7d63-4f9a-be56-ff498118e97c", "name": "network-vif-deleted", "tag": "2da04427-a247-4f2b-8fae-9dd8d6672da1"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:42.397859 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-4997db92-bf1c-4d34-92f1-1c30ab92ae25 req-d52dcc82-d362-4145-962f-e3f8697f89a4 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:42.398579 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-4997db92-bf1c-4d34-92f1-1c30ab92ae25 req-d52dcc82-d362-4145-962f-e3f8697f89a4 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:42.413174 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-4997db92-bf1c-4d34-92f1-1c30ab92ae25 req-d52dcc82-d362-4145-962f-e3f8697f89a4 service nova] Creating event network-vif-deleted:2da04427-a247-4f2b-8fae-9dd8d6672da1 for instance eba8d6de-7d63-4f9a-be56-ff498118e97c on hv-cinder-83538 Jul 26 17:20:42.419967 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-4997db92-bf1c-4d34-92f1-1c30ab92ae25 req-d52dcc82-d362-4145-962f-e3f8697f89a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040544 Jul 26 17:20:42.421252 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 443/947] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:20:42.900424 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d78cc08e-8041-4ad1-a25d-b632b3578251 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:42.901368 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d78cc08e-8041-4ad1-a25d-b632b3578251 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:42.908433 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d78cc08e-8041-4ad1-a25d-b632b3578251 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:42.908951 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d78cc08e-8041-4ad1-a25d-b632b3578251 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:42.910126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d78cc08e-8041-4ad1-a25d-b632b3578251 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:42.910577 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d78cc08e-8041-4ad1-a25d-b632b3578251 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:43.004571 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-13ef2154-7056-4452-98f0-77fb009278e6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:43.006029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-13ef2154-7056-4452-98f0-77fb009278e6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:43.015266 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-13ef2154-7056-4452-98f0-77fb009278e6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:43.016316 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-13ef2154-7056-4452-98f0-77fb009278e6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:43.016781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-13ef2154-7056-4452-98f0-77fb009278e6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:43.017351 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-13ef2154-7056-4452-98f0-77fb009278e6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:43.098464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-13ef2154-7056-4452-98f0-77fb009278e6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:43.109754 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d78cc08e-8041-4ad1-a25d-b632b3578251 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:43.111359 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-13ef2154-7056-4452-98f0-77fb009278e6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 200 len: 1226 microversion: 2.1 time: 0.113461 Jul 26 17:20:43.112457 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 444/948] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:42 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 1226 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:20:43.114797 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:43.120785 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d78cc08e-8041-4ad1-a25d-b632b3578251 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.225306 Jul 26 17:20:43.131773 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 505/949] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:42 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:43.158885 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2dc422aa-13d0-48f0-a640-625fa8deb224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:43.159574 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2dc422aa-13d0-48f0-a640-625fa8deb224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:43.178867 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2dc422aa-13d0-48f0-a640-625fa8deb224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:43.179309 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2dc422aa-13d0-48f0-a640-625fa8deb224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:43.180094 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2dc422aa-13d0-48f0-a640-625fa8deb224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:43.180715 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2dc422aa-13d0-48f0-a640-625fa8deb224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:43.208555 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-2dc422aa-13d0-48f0-a640-625fa8deb224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2dc422aa-13d0-48f0-a640-625fa8deb224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: DELETE /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea HTTP/1.1 Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:20:43.210620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:20:43.212296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:43.212296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:43.212296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:43.212296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:43.212296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:43.212296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:20:43.212296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:20:43.212296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:20:43.212296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:43.212296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:20:43.212296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:20:43.212296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '20195acb-7356-4e87-a2a8-1ee88cd3e3ea'} Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:43.213930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:20:43.215464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:43.217471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2dc422aa-13d0-48f0-a640-625fa8deb224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 404 to user: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:43.217471 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2dc422aa-13d0-48f0-a640-625fa8deb224 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 404 len: 111 microversion: 2.1 time: 0.057478 Jul 26 17:20:43.223019 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-df6d4504-5e8e-4976-8af7-f132349204e5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:43.223566 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 445/950] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:20:43 2022] DELETE /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:43.223879 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-df6d4504-5e8e-4976-8af7-f132349204e5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] [instance: 20195acb-7356-4e87-a2a8-1ee88cd3e3ea] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:43.232780 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df6d4504-5e8e-4976-8af7-f132349204e5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:43.233344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df6d4504-5e8e-4976-8af7-f132349204e5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:43.234265 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df6d4504-5e8e-4976-8af7-f132349204e5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:43.234446 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df6d4504-5e8e-4976-8af7-f132349204e5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:43.270579 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-df6d4504-5e8e-4976-8af7-f132349204e5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] HTTP exception thrown: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-df6d4504-5e8e-4976-8af7-f132349204e5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Request method failure captured: Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea HTTP/1.1 Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CCsadVyZ4vk33tp9vsTTgPSSbKKkAQFjXI_MrJcbeto74BlN9REbXoHjZIpuiz7DutiGsiKa1ynaqc1BSJU8-kaEeGBAUIVvIrPvQIOveMj6ExpmofEZ3U2NPKnn2DROK_bOwBBHoTf841OOBUQVFZ63OnlLv5ZwQlLnHISnIY2Jls Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:20:43.272997 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:20:43.274613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/446eaae0a4f34eba86d4b0de0c2d1013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:43.274613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:43.274613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 446eaae0a4f34eba86d4b0de0c2d1013 Jul 26 17:20:43.274613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-474680501 Jul 26 17:20:43.274613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:43.274613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:20:43.274613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:20:43.274613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: c6291932ceb84b03924c0f056f29c2a9 Jul 26 17:20:43.274613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeNegativeTest-474680501-project Jul 26 17:20:43.274613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:20:43.274613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:20:43.274613 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '20195acb-7356-4e87-a2a8-1ee88cd3e3ea'} Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:43.276259 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. Jul 26 17:20:43.277725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:20:43.280042 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-df6d4504-5e8e-4976-8af7-f132349204e5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] Returning 404 to user: Instance 20195acb-7356-4e87-a2a8-1ee88cd3e3ea could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:43.282009 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-df6d4504-5e8e-4976-8af7-f132349204e5 tempest-AttachVolumeNegativeTest-474680501 tempest-AttachVolumeNegativeTest-474680501-project] 10.222.0.48 "GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea" status: 404 len: 111 microversion: 2.1 time: 0.062491 Jul 26 17:20:43.283218 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 506/951] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:43 2022] GET /compute/v2.1/servers/20195acb-7356-4e87-a2a8-1ee88cd3e3ea => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:44.132944 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1f038923-b98f-4e8a-887f-0f789ba52512 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:44.133575 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1f038923-b98f-4e8a-887f-0f789ba52512 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:44.140638 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1f038923-b98f-4e8a-887f-0f789ba52512 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:44.141123 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1f038923-b98f-4e8a-887f-0f789ba52512 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:44.141913 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1f038923-b98f-4e8a-887f-0f789ba52512 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:44.142333 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1f038923-b98f-4e8a-887f-0f789ba52512 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:44.142793 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-38a9f840-4530-488f-affb-888ba4402518 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:44.143508 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-38a9f840-4530-488f-affb-888ba4402518 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:44.150701 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38a9f840-4530-488f-affb-888ba4402518 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:44.151368 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38a9f840-4530-488f-affb-888ba4402518 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:44.152254 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38a9f840-4530-488f-affb-888ba4402518 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:44.152790 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38a9f840-4530-488f-affb-888ba4402518 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:44.157209 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-1f038923-b98f-4e8a-887f-0f789ba52512 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] HTTP exception thrown: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1f038923-b98f-4e8a-887f-0f789ba52512 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Request method failure captured: Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c HTTP/1.1 Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CGnujxWd0FjjiQ0ACbbZRG7WH8zUF71oGkyN9PyaPeUq_7SQMn3dkCArL-V3RWfebePx5l38h2REnFy4Z85kMOmvCxTNw0TwZZRP345HeL0zWAhoMshwJb4pyue9mArAHVPxAz_UhOHyyXtU2cQIdzUm3V9-NnKiejjX8pKmyF4mPo Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: b888b1053bb043dbb88d674c9a504a86 Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-TestVolumeBootPattern-923472015 Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:20:44.158732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:20:44.160430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:20:44.160430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-TestVolumeBootPattern-923472015 Jul 26 17:20:44.160430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: b888b1053bb043dbb88d674c9a504a86 Jul 26 17:20:44.160430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-TestVolumeBootPattern-923472015 Jul 26 17:20:44.160430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-TestVolumeBootPattern-923472015-project Jul 26 17:20:44.160430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:20:44.160430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:20:44.160430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: dcf968aeb53c4215927642e9931b4a5e Jul 26 17:20:44.160430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-TestVolumeBootPattern-923472015-project Jul 26 17:20:44.160430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:20:44.160430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:20:44.160430 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': 'eba8d6de-7d63-4f9a-be56-ff498118e97c'} Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:20:44.169917 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:20:44.171474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:20:44.172625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1f038923-b98f-4e8a-887f-0f789ba52512 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Returning 404 to user: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:20:44.172625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1f038923-b98f-4e8a-887f-0f789ba52512 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 404 len: 111 microversion: 2.1 time: 0.031013 Jul 26 17:20:44.172625 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 446/952] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:44 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:20:44.259920 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1102529795", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1393964861", "security_groups": [{"name": "tempest-secgroup-smoke-1628658040"}], "block_device_mapping_v2": [{"uuid": "e6530c00-c722-4269-b83b-8f60bd1f2729", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dc0fe413-bc4b-4401-bb71-d74110a1081f"}]}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:44.389558 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-38a9f840-4530-488f-affb-888ba4402518 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:44.396084 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.network.neutron [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] validate_networks() for [('dc0fe413-bc4b-4401-bb71-d74110a1081f', None, None, None, None, None)] {{(pid=118122) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:20:44.409083 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-38a9f840-4530-488f-affb-888ba4402518 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.270459 Jul 26 17:20:44.413206 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 507/953] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:44 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:44.879176 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Flavor limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:20:44.879607 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Image limits 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:20:44.880081 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Flavor pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:20:44.880489 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Image pref 0:0:0 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:20:44.880900 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.virt.hardware [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:20:44.890751 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:44.891195 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:44.892177 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:44.892816 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:44.912979 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Getting quotas for project b888b1053bb043dbb88d674c9a504a86. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:20:44.918747 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Getting quotas for user dcf968aeb53c4215927642e9931b4a5e and project b888b1053bb043dbb88d674c9a504a86. Resources: {'instances', 'ram', 'cores'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:20:44.981676 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Going to run 1 instances... {{(pid=118122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:20:44.984182 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6530c00-c722-4269-b83b-8f60bd1f2729',volume_size=None,volume_type=None)] {{(pid=118122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:20:45.138720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-db44d2cb-1de4-4fa9-af88-57eb288d372b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.882535 Jul 26 17:20:45.139458 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 447/954] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:20:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 17:20:45.151490 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5f32c44f-1891-413f-b85b-604c6710488a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:45.152736 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5f32c44f-1891-413f-b85b-604c6710488a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:45.229542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5f32c44f-1891-413f-b85b-604c6710488a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:45.238089 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5f32c44f-1891-413f-b85b-604c6710488a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1095 microversion: 2.1 time: 0.091276 Jul 26 17:20:45.249643 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 508/955] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:45 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:45.431258 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1ed1690a-161d-4ec9-8c1a-21f9df2b2011 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:45.432539 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1ed1690a-161d-4ec9-8c1a-21f9df2b2011 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:45.444934 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1ed1690a-161d-4ec9-8c1a-21f9df2b2011 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:45.445800 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1ed1690a-161d-4ec9-8c1a-21f9df2b2011 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:45.447311 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1ed1690a-161d-4ec9-8c1a-21f9df2b2011 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:45.448112 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1ed1690a-161d-4ec9-8c1a-21f9df2b2011 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:45.636273 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1ed1690a-161d-4ec9-8c1a-21f9df2b2011 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:45.644493 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1ed1690a-161d-4ec9-8c1a-21f9df2b2011 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.217314 Jul 26 17:20:45.645017 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 448/956] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:45 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:46.260097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b49b751e-f874-4312-b12a-79c9beb5e4fe tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:46.261900 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b49b751e-f874-4312-b12a-79c9beb5e4fe tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:46.269993 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b49b751e-f874-4312-b12a-79c9beb5e4fe tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:46.270571 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b49b751e-f874-4312-b12a-79c9beb5e4fe tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:46.271420 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b49b751e-f874-4312-b12a-79c9beb5e4fe tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:46.271925 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b49b751e-f874-4312-b12a-79c9beb5e4fe tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:46.368222 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b49b751e-f874-4312-b12a-79c9beb5e4fe tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:46.380158 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b49b751e-f874-4312-b12a-79c9beb5e4fe tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1145 microversion: 2.1 time: 0.124236 Jul 26 17:20:46.381333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 509/957] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:46 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1145 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:46.666899 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0cb9aa2f-1fa5-4f3a-b97b-a4aa4c116720 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:46.667510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0cb9aa2f-1fa5-4f3a-b97b-a4aa4c116720 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:46.674120 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0cb9aa2f-1fa5-4f3a-b97b-a4aa4c116720 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:46.674597 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0cb9aa2f-1fa5-4f3a-b97b-a4aa4c116720 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:46.675367 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0cb9aa2f-1fa5-4f3a-b97b-a4aa4c116720 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:46.675832 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0cb9aa2f-1fa5-4f3a-b97b-a4aa4c116720 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:46.901856 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0cb9aa2f-1fa5-4f3a-b97b-a4aa4c116720 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:46.911617 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0cb9aa2f-1fa5-4f3a-b97b-a4aa4c116720 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.249227 Jul 26 17:20:46.912700 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 449/958] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:46 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:47.412151 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2de60c6f-23df-4819-88de-feeb93dd7bb6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:47.412774 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2de60c6f-23df-4819-88de-feeb93dd7bb6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:47.423582 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2de60c6f-23df-4819-88de-feeb93dd7bb6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:47.429986 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2de60c6f-23df-4819-88de-feeb93dd7bb6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:47.431737 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2de60c6f-23df-4819-88de-feeb93dd7bb6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:47.433536 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2de60c6f-23df-4819-88de-feeb93dd7bb6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:47.537347 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2de60c6f-23df-4819-88de-feeb93dd7bb6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:47.550323 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2de60c6f-23df-4819-88de-feeb93dd7bb6 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1211 microversion: 2.1 time: 0.152271 Jul 26 17:20:47.551771 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 510/959] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:47 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1211 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:47.934956 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c1546145-5160-452b-99a5-19a26ed24ff6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:47.936528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c1546145-5160-452b-99a5-19a26ed24ff6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:47.946840 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1546145-5160-452b-99a5-19a26ed24ff6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:47.947429 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1546145-5160-452b-99a5-19a26ed24ff6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:47.948319 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1546145-5160-452b-99a5-19a26ed24ff6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:47.948986 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1546145-5160-452b-99a5-19a26ed24ff6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:48.122931 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c1546145-5160-452b-99a5-19a26ed24ff6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:48.172252 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c1546145-5160-452b-99a5-19a26ed24ff6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.236162 Jul 26 17:20:48.172901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 450/960] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:47 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:20:48.573386 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-71331fa1-ccf5-4ed5-bc38-1080a9453fd8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:48.574161 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-71331fa1-ccf5-4ed5-bc38-1080a9453fd8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:48.583763 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71331fa1-ccf5-4ed5-bc38-1080a9453fd8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:48.584596 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71331fa1-ccf5-4ed5-bc38-1080a9453fd8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:48.585626 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71331fa1-ccf5-4ed5-bc38-1080a9453fd8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:48.587818 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71331fa1-ccf5-4ed5-bc38-1080a9453fd8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:48.754612 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-71331fa1-ccf5-4ed5-bc38-1080a9453fd8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:48.770540 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-71331fa1-ccf5-4ed5-bc38-1080a9453fd8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1279 microversion: 2.1 time: 0.202664 Jul 26 17:20:48.771231 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 511/961] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:48 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1279 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:49.194269 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-b7936e2b-5190-485d-a2be-60014d6139f1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:49.194879 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-b7936e2b-5190-485d-a2be-60014d6139f1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:49.202955 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b7936e2b-5190-485d-a2be-60014d6139f1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:49.203400 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b7936e2b-5190-485d-a2be-60014d6139f1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:49.204166 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b7936e2b-5190-485d-a2be-60014d6139f1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:49.204723 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-b7936e2b-5190-485d-a2be-60014d6139f1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:49.209528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:49.354512 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-b7936e2b-5190-485d-a2be-60014d6139f1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:49.367480 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-b7936e2b-5190-485d-a2be-60014d6139f1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.177206 Jul 26 17:20:49.368121 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 451/962] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:49 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:49.792118 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cc74bced-97d3-4aed-a6ce-f54316504026 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:49.792725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cc74bced-97d3-4aed-a6ce-f54316504026 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:49.800124 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc74bced-97d3-4aed-a6ce-f54316504026 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:49.800578 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc74bced-97d3-4aed-a6ce-f54316504026 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:49.801379 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc74bced-97d3-4aed-a6ce-f54316504026 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:49.801816 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc74bced-97d3-4aed-a6ce-f54316504026 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:49.955786 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cc74bced-97d3-4aed-a6ce-f54316504026 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:49.967303 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cc74bced-97d3-4aed-a6ce-f54316504026 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1279 microversion: 2.1 time: 0.179446 Jul 26 17:20:49.968074 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 512/963] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:49 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:50.388930 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-888c8377-4bd5-4134-bb19-f540030c0325 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:50.389555 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-888c8377-4bd5-4134-bb19-f540030c0325 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:50.397302 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-888c8377-4bd5-4134-bb19-f540030c0325 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:50.397805 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-888c8377-4bd5-4134-bb19-f540030c0325 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:50.398591 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-888c8377-4bd5-4134-bb19-f540030c0325 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:50.399031 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-888c8377-4bd5-4134-bb19-f540030c0325 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:50.557101 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-888c8377-4bd5-4134-bb19-f540030c0325 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:50.566998 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-888c8377-4bd5-4134-bb19-f540030c0325 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.181995 Jul 26 17:20:50.568002 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 452/964] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:50 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:50.988951 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f9f4dc0b-b182-4bcc-a197-649182812899 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:50.989602 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f9f4dc0b-b182-4bcc-a197-649182812899 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:50.997298 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9f4dc0b-b182-4bcc-a197-649182812899 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:50.997683 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9f4dc0b-b182-4bcc-a197-649182812899 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:50.998725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9f4dc0b-b182-4bcc-a197-649182812899 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:50.999180 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9f4dc0b-b182-4bcc-a197-649182812899 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:51.409976 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f9f4dc0b-b182-4bcc-a197-649182812899 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:51.419024 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f9f4dc0b-b182-4bcc-a197-649182812899 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1279 microversion: 2.1 time: 0.434010 Jul 26 17:20:51.419602 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 513/965] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:50 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1279 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:51.590016 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8d2271d0-65fa-4dac-b917-c75d55215585 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:51.590743 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8d2271d0-65fa-4dac-b917-c75d55215585 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:51.602438 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8d2271d0-65fa-4dac-b917-c75d55215585 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:51.602895 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8d2271d0-65fa-4dac-b917-c75d55215585 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:51.603680 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8d2271d0-65fa-4dac-b917-c75d55215585 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:51.604122 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8d2271d0-65fa-4dac-b917-c75d55215585 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:51.741909 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8d2271d0-65fa-4dac-b917-c75d55215585 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:51.750933 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8d2271d0-65fa-4dac-b917-c75d55215585 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.166596 Jul 26 17:20:51.751512 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 453/966] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:51 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:52.444606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d86e02d9-726f-4d0e-b1aa-9fa838183a0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:52.445224 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d86e02d9-726f-4d0e-b1aa-9fa838183a0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:52.465156 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d86e02d9-726f-4d0e-b1aa-9fa838183a0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:52.467723 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d86e02d9-726f-4d0e-b1aa-9fa838183a0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:52.469214 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d86e02d9-726f-4d0e-b1aa-9fa838183a0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:52.469666 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d86e02d9-726f-4d0e-b1aa-9fa838183a0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:52.637784 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d86e02d9-726f-4d0e-b1aa-9fa838183a0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:52.646760 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d86e02d9-726f-4d0e-b1aa-9fa838183a0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1279 microversion: 2.1 time: 0.208482 Jul 26 17:20:52.648127 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 514/967] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:52 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1279 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:52.774137 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3f7b8385-2c6e-44d8-a273-274ca93af361 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:52.775559 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3f7b8385-2c6e-44d8-a273-274ca93af361 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:52.789663 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:52.798013 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3f7b8385-2c6e-44d8-a273-274ca93af361 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:52.798823 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3f7b8385-2c6e-44d8-a273-274ca93af361 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:52.799995 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3f7b8385-2c6e-44d8-a273-274ca93af361 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:52.801514 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3f7b8385-2c6e-44d8-a273-274ca93af361 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:53.066971 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3f7b8385-2c6e-44d8-a273-274ca93af361 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:53.075311 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3f7b8385-2c6e-44d8-a273-274ca93af361 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.307072 Jul 26 17:20:53.076124 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 454/968] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:52 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:53.541437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-1656e353-9bd4-4c80-ab0f-c2fe29d91ef7 req-5049cefc-b16d-4469-86fc-2ff9a0e7f132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57f28568-123d-4639-84a9-4d0c501c1b44", "tag": "4ee619b1-bb35-434c-bfa4-65aff71afd6b"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:53.552484 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-1656e353-9bd4-4c80-ab0f-c2fe29d91ef7 req-5049cefc-b16d-4469-86fc-2ff9a0e7f132 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:53.553285 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-1656e353-9bd4-4c80-ab0f-c2fe29d91ef7 req-5049cefc-b16d-4469-86fc-2ff9a0e7f132 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:53.569156 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-1656e353-9bd4-4c80-ab0f-c2fe29d91ef7 req-5049cefc-b16d-4469-86fc-2ff9a0e7f132 service nova] Creating event network-changed:4ee619b1-bb35-434c-bfa4-65aff71afd6b for instance 57f28568-123d-4639-84a9-4d0c501c1b44 on hv-cinder-83538 Jul 26 17:20:53.575916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-1656e353-9bd4-4c80-ab0f-c2fe29d91ef7 req-5049cefc-b16d-4469-86fc-2ff9a0e7f132 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039650 Jul 26 17:20:53.576995 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 515/969] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:20:53.670817 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e81e20e6-ae28-479b-9c93-a7289a575b08 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:53.671566 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-e81e20e6-ae28-479b-9c93-a7289a575b08 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:53.680074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e81e20e6-ae28-479b-9c93-a7289a575b08 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:53.680587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e81e20e6-ae28-479b-9c93-a7289a575b08 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:53.682741 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e81e20e6-ae28-479b-9c93-a7289a575b08 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:53.683196 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-e81e20e6-ae28-479b-9c93-a7289a575b08 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:53.888338 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-e81e20e6-ae28-479b-9c93-a7289a575b08 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:53.897456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e81e20e6-ae28-479b-9c93-a7289a575b08 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1267 microversion: 2.1 time: 0.232210 Jul 26 17:20:53.903638 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 455/970] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:53 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:54.098250 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f9f00deb-f5ed-4e3c-b5ce-adb86e0f19ad tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:54.098965 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f9f00deb-f5ed-4e3c-b5ce-adb86e0f19ad tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:54.111195 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9f00deb-f5ed-4e3c-b5ce-adb86e0f19ad tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:54.111873 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9f00deb-f5ed-4e3c-b5ce-adb86e0f19ad tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:54.113862 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9f00deb-f5ed-4e3c-b5ce-adb86e0f19ad tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:54.114335 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9f00deb-f5ed-4e3c-b5ce-adb86e0f19ad tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:54.312051 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f9f00deb-f5ed-4e3c-b5ce-adb86e0f19ad tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:54.319814 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f9f00deb-f5ed-4e3c-b5ce-adb86e0f19ad tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.226342 Jul 26 17:20:54.333441 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 516/971] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:54 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:54.919803 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-015109bc-979a-4802-88dc-f69483cd5226 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:54.920645 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-015109bc-979a-4802-88dc-f69483cd5226 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:54.923099 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:54.924912 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=6 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:54.929637 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-015109bc-979a-4802-88dc-f69483cd5226 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:54.930082 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-015109bc-979a-4802-88dc-f69483cd5226 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:54.930854 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-015109bc-979a-4802-88dc-f69483cd5226 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:54.931284 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-015109bc-979a-4802-88dc-f69483cd5226 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:55.071647 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-015109bc-979a-4802-88dc-f69483cd5226 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:55.079868 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-015109bc-979a-4802-88dc-f69483cd5226 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1267 microversion: 2.1 time: 0.163874 Jul 26 17:20:55.080431 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 456/972] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:54 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:55.342135 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ff5f17b7-2eb9-44c0-a417-cc2f3e2daab1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:55.342828 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ff5f17b7-2eb9-44c0-a417-cc2f3e2daab1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:55.345273 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:55.351247 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff5f17b7-2eb9-44c0-a417-cc2f3e2daab1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:55.355070 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff5f17b7-2eb9-44c0-a417-cc2f3e2daab1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:55.355070 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff5f17b7-2eb9-44c0-a417-cc2f3e2daab1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:55.355070 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff5f17b7-2eb9-44c0-a417-cc2f3e2daab1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:55.496519 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ff5f17b7-2eb9-44c0-a417-cc2f3e2daab1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:55.505331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ff5f17b7-2eb9-44c0-a417-cc2f3e2daab1 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.167943 Jul 26 17:20:55.505967 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 517/973] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:55 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:56.101605 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-387c68d3-08b3-4854-bc1c-117a240d04f9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:56.102207 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-387c68d3-08b3-4854-bc1c-117a240d04f9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:56.108760 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-387c68d3-08b3-4854-bc1c-117a240d04f9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:56.109237 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-387c68d3-08b3-4854-bc1c-117a240d04f9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:56.110033 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-387c68d3-08b3-4854-bc1c-117a240d04f9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:56.110468 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-387c68d3-08b3-4854-bc1c-117a240d04f9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:56.261570 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-387c68d3-08b3-4854-bc1c-117a240d04f9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:56.269794 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-387c68d3-08b3-4854-bc1c-117a240d04f9 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1267 microversion: 2.1 time: 0.171911 Jul 26 17:20:56.270382 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 457/974] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:56 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:56.528595 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-67faadae-964b-42eb-bfee-29ce1639bd04 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:56.529253 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-67faadae-964b-42eb-bfee-29ce1639bd04 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:56.531621 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:20:56.536758 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67faadae-964b-42eb-bfee-29ce1639bd04 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:56.537476 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67faadae-964b-42eb-bfee-29ce1639bd04 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:56.538251 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67faadae-964b-42eb-bfee-29ce1639bd04 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:56.538690 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67faadae-964b-42eb-bfee-29ce1639bd04 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:56.682504 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-67faadae-964b-42eb-bfee-29ce1639bd04 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:56.690541 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-67faadae-964b-42eb-bfee-29ce1639bd04 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.166267 Jul 26 17:20:56.690759 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 518/975] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:56 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:57.293403 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4e6b3b62-2ca0-4e2c-a774-a73da395dc05 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:57.294830 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4e6b3b62-2ca0-4e2c-a774-a73da395dc05 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:57.301677 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4e6b3b62-2ca0-4e2c-a774-a73da395dc05 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:57.302128 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4e6b3b62-2ca0-4e2c-a774-a73da395dc05 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:57.303126 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4e6b3b62-2ca0-4e2c-a774-a73da395dc05 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:57.303562 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4e6b3b62-2ca0-4e2c-a774-a73da395dc05 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:57.476437 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4e6b3b62-2ca0-4e2c-a774-a73da395dc05 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:57.486568 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4e6b3b62-2ca0-4e2c-a774-a73da395dc05 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1267 microversion: 2.1 time: 0.198137 Jul 26 17:20:57.489341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 458/976] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:57 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:57.663373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-b9c5ba0f-1788-41cc-ba5e-8743c3d743c3 req-de1bf979-e2d8-4ab6-bb47-e568f98797aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b93f34-9005-40dc-acb1-496c1eaf53c6", "name": "network-vif-plugged", "status": "completed", "tag": "106ac6cf-a172-4113-980c-418b8d51f6a4"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:20:57.684352 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-b9c5ba0f-1788-41cc-ba5e-8743c3d743c3 req-de1bf979-e2d8-4ab6-bb47-e568f98797aa service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:57.685795 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-b9c5ba0f-1788-41cc-ba5e-8743c3d743c3 req-de1bf979-e2d8-4ab6-bb47-e568f98797aa service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:57.705146 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-b9c5ba0f-1788-41cc-ba5e-8743c3d743c3 req-de1bf979-e2d8-4ab6-bb47-e568f98797aa service nova] Creating event network-vif-plugged:106ac6cf-a172-4113-980c-418b8d51f6a4 for instance 95b93f34-9005-40dc-acb1-496c1eaf53c6 on hv-cinder-83538 Jul 26 17:20:57.711033 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-b9c5ba0f-1788-41cc-ba5e-8743c3d743c3 req-de1bf979-e2d8-4ab6-bb47-e568f98797aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051427 Jul 26 17:20:57.711837 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-bef39190-9508-4139-9942-4ec443ca0d88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:57.712469 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-bef39190-9508-4139-9942-4ec443ca0d88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:57.712796 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 519/977] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:20:57.723207 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bef39190-9508-4139-9942-4ec443ca0d88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:57.723708 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bef39190-9508-4139-9942-4ec443ca0d88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:57.724439 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bef39190-9508-4139-9942-4ec443ca0d88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:57.724905 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-bef39190-9508-4139-9942-4ec443ca0d88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:57.925496 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-bef39190-9508-4139-9942-4ec443ca0d88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:57.933302 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-bef39190-9508-4139-9942-4ec443ca0d88 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.225271 Jul 26 17:20:57.933898 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 459/978] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:57 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:20:58.510355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-65a2acda-1cbb-4a86-bb89-9b81e9b953db tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:58.511050 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-65a2acda-1cbb-4a86-bb89-9b81e9b953db tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:58.518114 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65a2acda-1cbb-4a86-bb89-9b81e9b953db tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:58.518631 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65a2acda-1cbb-4a86-bb89-9b81e9b953db tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:58.519404 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65a2acda-1cbb-4a86-bb89-9b81e9b953db tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:58.519906 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65a2acda-1cbb-4a86-bb89-9b81e9b953db tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:58.664490 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-65a2acda-1cbb-4a86-bb89-9b81e9b953db tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:58.672102 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-65a2acda-1cbb-4a86-bb89-9b81e9b953db tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1267 microversion: 2.1 time: 0.166927 Jul 26 17:20:58.672668 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 520/979] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:58 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:20:58.956432 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0f4158de-4f00-4ca0-8763-83b3a4f1a27b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:58.957054 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0f4158de-4f00-4ca0-8763-83b3a4f1a27b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:58.964034 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0f4158de-4f00-4ca0-8763-83b3a4f1a27b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:58.964584 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0f4158de-4f00-4ca0-8763-83b3a4f1a27b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:58.965304 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0f4158de-4f00-4ca0-8763-83b3a4f1a27b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:58.965744 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0f4158de-4f00-4ca0-8763-83b3a4f1a27b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:59.113123 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0f4158de-4f00-4ca0-8763-83b3a4f1a27b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:59.121899 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0f4158de-4f00-4ca0-8763-83b3a4f1a27b tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1575 microversion: 2.1 time: 0.169243 Jul 26 17:20:59.122464 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 460/980] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:58 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:20:59.693340 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ea65b3f-f088-4e59-b7d0-04919a911ba8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:20:59.693986 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ea65b3f-f088-4e59-b7d0-04919a911ba8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:20:59.701144 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ea65b3f-f088-4e59-b7d0-04919a911ba8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:59.701601 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ea65b3f-f088-4e59-b7d0-04919a911ba8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:59.702385 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ea65b3f-f088-4e59-b7d0-04919a911ba8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:20:59.702828 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ea65b3f-f088-4e59-b7d0-04919a911ba8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:20:59.838296 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ea65b3f-f088-4e59-b7d0-04919a911ba8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:20:59.845975 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ea65b3f-f088-4e59-b7d0-04919a911ba8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1267 microversion: 2.1 time: 0.156615 Jul 26 17:20:59.846538 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 521/981] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:20:59 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:00.147469 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2c74f383-1728-4501-b2a9-a173bbc47283 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:00.147469 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2c74f383-1728-4501-b2a9-a173bbc47283 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:00.152277 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2c74f383-1728-4501-b2a9-a173bbc47283 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:00.152740 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2c74f383-1728-4501-b2a9-a173bbc47283 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:00.153578 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2c74f383-1728-4501-b2a9-a173bbc47283 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:00.154084 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2c74f383-1728-4501-b2a9-a173bbc47283 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:00.299835 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-2c74f383-1728-4501-b2a9-a173bbc47283 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:00.308662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2c74f383-1728-4501-b2a9-a173bbc47283 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1562 microversion: 2.1 time: 0.168701 Jul 26 17:21:00.309386 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 461/982] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:00 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:00.868713 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b5e280bd-e710-4c51-9497-ceac2e6d5a50 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:00.869333 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b5e280bd-e710-4c51-9497-ceac2e6d5a50 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:00.876428 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5e280bd-e710-4c51-9497-ceac2e6d5a50 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:00.876866 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5e280bd-e710-4c51-9497-ceac2e6d5a50 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:00.877681 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5e280bd-e710-4c51-9497-ceac2e6d5a50 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:00.878119 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5e280bd-e710-4c51-9497-ceac2e6d5a50 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:01.023864 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b5e280bd-e710-4c51-9497-ceac2e6d5a50 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:01.032988 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b5e280bd-e710-4c51-9497-ceac2e6d5a50 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1267 microversion: 2.1 time: 0.168452 Jul 26 17:21:01.033799 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 522/983] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:00 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:02.055912 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f080bae3-1b27-4c96-8926-a246152a958e tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:02.057179 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-f080bae3-1b27-4c96-8926-a246152a958e tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:02.064017 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f080bae3-1b27-4c96-8926-a246152a958e tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:02.064467 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f080bae3-1b27-4c96-8926-a246152a958e tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:02.065311 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f080bae3-1b27-4c96-8926-a246152a958e tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:02.065751 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f080bae3-1b27-4c96-8926-a246152a958e tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:02.224415 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-f080bae3-1b27-4c96-8926-a246152a958e tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:02.237178 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-f080bae3-1b27-4c96-8926-a246152a958e tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1267 microversion: 2.1 time: 0.185996 Jul 26 17:21:02.237783 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 462/984] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:02 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:03.262401 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cf912eda-6350-4fda-bfca-11145467a199 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:03.264010 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cf912eda-6350-4fda-bfca-11145467a199 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:03.271396 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf912eda-6350-4fda-bfca-11145467a199 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:03.271859 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf912eda-6350-4fda-bfca-11145467a199 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:03.272638 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf912eda-6350-4fda-bfca-11145467a199 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:03.273106 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf912eda-6350-4fda-bfca-11145467a199 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:03.414453 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cf912eda-6350-4fda-bfca-11145467a199 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:03.422115 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cf912eda-6350-4fda-bfca-11145467a199 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1267 microversion: 2.1 time: 0.165662 Jul 26 17:21:03.422693 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 523/985] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:03 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:04.443639 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f44e87bc-b7e2-42a6-95f3-087d656bbb3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:04.444248 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-f44e87bc-b7e2-42a6-95f3-087d656bbb3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:04.451758 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f44e87bc-b7e2-42a6-95f3-087d656bbb3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:04.452206 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f44e87bc-b7e2-42a6-95f3-087d656bbb3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:04.453259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f44e87bc-b7e2-42a6-95f3-087d656bbb3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:04.453694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f44e87bc-b7e2-42a6-95f3-087d656bbb3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:04.608534 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-f44e87bc-b7e2-42a6-95f3-087d656bbb3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:04.616792 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-f44e87bc-b7e2-42a6-95f3-087d656bbb3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1267 microversion: 2.1 time: 0.177047 Jul 26 17:21:04.617405 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 463/986] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:04 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:05.640159 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8d58f52f-117a-4b8e-bf06-69bde0a84fde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:05.640790 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8d58f52f-117a-4b8e-bf06-69bde0a84fde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:05.650456 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8d58f52f-117a-4b8e-bf06-69bde0a84fde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:05.651155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8d58f52f-117a-4b8e-bf06-69bde0a84fde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:05.652126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8d58f52f-117a-4b8e-bf06-69bde0a84fde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:05.652593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8d58f52f-117a-4b8e-bf06-69bde0a84fde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:05.699394 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-089d7564-685e-4506-bc16-234c4ada71cf req-4bbd4031-ccea-415b-8cb9-a8f53a40ec56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57f28568-123d-4639-84a9-4d0c501c1b44", "name": "network-vif-plugged", "status": "completed", "tag": "4ee619b1-bb35-434c-bfa4-65aff71afd6b"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:21:05.725765 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-089d7564-685e-4506-bc16-234c4ada71cf req-4bbd4031-ccea-415b-8cb9-a8f53a40ec56 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:05.728179 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-089d7564-685e-4506-bc16-234c4ada71cf req-4bbd4031-ccea-415b-8cb9-a8f53a40ec56 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:05.931382 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-089d7564-685e-4506-bc16-234c4ada71cf req-4bbd4031-ccea-415b-8cb9-a8f53a40ec56 service nova] Creating event network-vif-plugged:4ee619b1-bb35-434c-bfa4-65aff71afd6b for instance 57f28568-123d-4639-84a9-4d0c501c1b44 on hv-cinder-83538 Jul 26 17:21:05.936816 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-089d7564-685e-4506-bc16-234c4ada71cf req-4bbd4031-ccea-415b-8cb9-a8f53a40ec56 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242298 Jul 26 17:21:05.937796 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 464/987] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:21:05.960558 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8d58f52f-117a-4b8e-bf06-69bde0a84fde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:05.971522 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8d58f52f-117a-4b8e-bf06-69bde0a84fde tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1267 microversion: 2.1 time: 0.336037 Jul 26 17:21:05.972234 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 524/988] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:05 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1267 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:06.994419 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-0ed4be55-4f07-4812-bdb8-2c7f20ac2739 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:06.995248 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-0ed4be55-4f07-4812-bdb8-2c7f20ac2739 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:07.005800 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0ed4be55-4f07-4812-bdb8-2c7f20ac2739 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:07.006319 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0ed4be55-4f07-4812-bdb8-2c7f20ac2739 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:07.007683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0ed4be55-4f07-4812-bdb8-2c7f20ac2739 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:07.007683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-0ed4be55-4f07-4812-bdb8-2c7f20ac2739 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:07.172553 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-0ed4be55-4f07-4812-bdb8-2c7f20ac2739 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:07.182051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-0ed4be55-4f07-4812-bdb8-2c7f20ac2739 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1267 microversion: 2.1 time: 0.192442 Jul 26 17:21:07.183015 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 465/989] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:06 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:08.206010 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-67efd74c-2e51-4e5c-b10e-b85903463e3c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:08.206893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-67efd74c-2e51-4e5c-b10e-b85903463e3c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:08.214685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67efd74c-2e51-4e5c-b10e-b85903463e3c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:08.215170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67efd74c-2e51-4e5c-b10e-b85903463e3c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:08.216017 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67efd74c-2e51-4e5c-b10e-b85903463e3c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:08.216495 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67efd74c-2e51-4e5c-b10e-b85903463e3c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:08.246158 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:21:08.385532 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-67efd74c-2e51-4e5c-b10e-b85903463e3c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:08.401007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-67efd74c-2e51-4e5c-b10e-b85903463e3c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1453 microversion: 2.1 time: 0.198616 Jul 26 17:21:08.401946 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 525/990] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:08 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1453 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:21:08.423020 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1b46367b-a8ca-4c9d-be05-0332010ded4d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:08.423922 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1b46367b-a8ca-4c9d-be05-0332010ded4d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:08.431086 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b46367b-a8ca-4c9d-be05-0332010ded4d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:08.431544 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b46367b-a8ca-4c9d-be05-0332010ded4d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:08.432327 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b46367b-a8ca-4c9d-be05-0332010ded4d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:08.432761 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1b46367b-a8ca-4c9d-be05-0332010ded4d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:08.578322 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1b46367b-a8ca-4c9d-be05-0332010ded4d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:08.585959 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1b46367b-a8ca-4c9d-be05-0332010ded4d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1453 microversion: 2.1 time: 0.167660 Jul 26 17:21:08.586907 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 466/991] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:08 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:10.533691 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-1bdec38c-3d93-4061-8f87-51da37760e89 req-0a8151f2-287b-4083-8227-4a2cfc49cba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57f28568-123d-4639-84a9-4d0c501c1b44", "tag": "4ee619b1-bb35-434c-bfa4-65aff71afd6b"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:21:10.544742 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-1bdec38c-3d93-4061-8f87-51da37760e89 req-0a8151f2-287b-4083-8227-4a2cfc49cba1 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:10.545342 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-1bdec38c-3d93-4061-8f87-51da37760e89 req-0a8151f2-287b-4083-8227-4a2cfc49cba1 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:10.558307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-1bdec38c-3d93-4061-8f87-51da37760e89 req-0a8151f2-287b-4083-8227-4a2cfc49cba1 service nova] Creating event network-changed:4ee619b1-bb35-434c-bfa4-65aff71afd6b for instance 57f28568-123d-4639-84a9-4d0c501c1b44 on hv-cinder-83538 Jul 26 17:21:10.564167 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-1bdec38c-3d93-4061-8f87-51da37760e89 req-0a8151f2-287b-4083-8227-4a2cfc49cba1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034174 Jul 26 17:21:10.565233 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 526/992] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:21:12.627458 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2d7923e7-7a40-42db-a4f4-64d9c0e6e30d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:12.629687 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2d7923e7-7a40-42db-a4f4-64d9c0e6e30d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:12.637886 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2d7923e7-7a40-42db-a4f4-64d9c0e6e30d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:12.639177 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2d7923e7-7a40-42db-a4f4-64d9c0e6e30d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:12.639302 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2d7923e7-7a40-42db-a4f4-64d9c0e6e30d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:12.639769 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2d7923e7-7a40-42db-a4f4-64d9c0e6e30d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:12.678991 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2d7923e7-7a40-42db-a4f4-64d9c0e6e30d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055696 Jul 26 17:21:12.679573 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 467/993] 10.222.0.48 () {60 vars in 1343 bytes} [Tue Jul 26 17:21:12 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:12.749820 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6f024d2b-4d4c-48e8-8b97-2a8a1261c702 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:12.750407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6f024d2b-4d4c-48e8-8b97-2a8a1261c702 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:12.759618 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f024d2b-4d4c-48e8-8b97-2a8a1261c702 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:12.760183 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f024d2b-4d4c-48e8-8b97-2a8a1261c702 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:12.761206 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f024d2b-4d4c-48e8-8b97-2a8a1261c702 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:12.761648 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f024d2b-4d4c-48e8-8b97-2a8a1261c702 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:12.788479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6f024d2b-4d4c-48e8-8b97-2a8a1261c702 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:21:12.877929 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6f024d2b-4d4c-48e8-8b97-2a8a1261c702 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "DELETE /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 204 len: 0 microversion: 2.20 time: 0.132994 Jul 26 17:21:12.879248 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 527/994] 10.222.0.48 () {60 vars in 1280 bytes} [Tue Jul 26 17:21:12 2022] DELETE /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 17:21:12.888153 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4f747e60-29ca-4d9b-a10d-d829e0b9e69d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:12.888802 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4f747e60-29ca-4d9b-a10d-d829e0b9e69d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:12.895775 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f747e60-29ca-4d9b-a10d-d829e0b9e69d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:12.896236 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f747e60-29ca-4d9b-a10d-d829e0b9e69d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:12.897051 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f747e60-29ca-4d9b-a10d-d829e0b9e69d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:12.897491 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4f747e60-29ca-4d9b-a10d-d829e0b9e69d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:12.913249 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=100 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:21:13.034339 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4f747e60-29ca-4d9b-a10d-d829e0b9e69d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:13.046151 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4f747e60-29ca-4d9b-a10d-d829e0b9e69d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:13.046702 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-4f747e60-29ca-4d9b-a10d-d829e0b9e69d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:13.047925 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4f747e60-29ca-4d9b-a10d-d829e0b9e69d tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.164076 Jul 26 17:21:13.048478 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 468/995] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:21:12 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 17:21:14.072811 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a6df5fa7-d74e-4f95-aba9-027ff11aa23f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:14.073472 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a6df5fa7-d74e-4f95-aba9-027ff11aa23f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:14.080481 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6df5fa7-d74e-4f95-aba9-027ff11aa23f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:14.080940 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6df5fa7-d74e-4f95-aba9-027ff11aa23f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:14.081764 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6df5fa7-d74e-4f95-aba9-027ff11aa23f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:14.082210 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6df5fa7-d74e-4f95-aba9-027ff11aa23f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:14.224723 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6df5fa7-d74e-4f95-aba9-027ff11aa23f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:14.233694 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6df5fa7-d74e-4f95-aba9-027ff11aa23f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:14.235256 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6df5fa7-d74e-4f95-aba9-027ff11aa23f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:14.236439 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a6df5fa7-d74e-4f95-aba9-027ff11aa23f tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.168239 Jul 26 17:21:14.237039 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 528/996] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:21:14 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:21:15.263150 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9faa211b-77fb-4852-b00e-ef1abd4c7d2c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:15.264884 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9faa211b-77fb-4852-b00e-ef1abd4c7d2c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:15.272501 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9faa211b-77fb-4852-b00e-ef1abd4c7d2c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:15.272985 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9faa211b-77fb-4852-b00e-ef1abd4c7d2c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:15.273905 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9faa211b-77fb-4852-b00e-ef1abd4c7d2c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:15.274494 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9faa211b-77fb-4852-b00e-ef1abd4c7d2c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:15.441519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9faa211b-77fb-4852-b00e-ef1abd4c7d2c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:15.451273 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9faa211b-77fb-4852-b00e-ef1abd4c7d2c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:15.452843 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9faa211b-77fb-4852-b00e-ef1abd4c7d2c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:15.454718 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9faa211b-77fb-4852-b00e-ef1abd4c7d2c tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1725 microversion: 2.20 time: 0.197083 Jul 26 17:21:15.455301 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 469/997] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:21:15 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:21:15.893639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-54594c8b-2d9f-465b-a0ac-9f4108f3cd63 req-d522c56f-10ea-49f3-a81a-d0ac2ae4ac65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a85ce7-0ab6-4543-a87c-8231bde9c4b5", "name": "network-vif-deleted", "tag": "76e89343-401e-41b9-8e6d-0ed7a6b1167b"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:21:15.920636 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-54594c8b-2d9f-465b-a0ac-9f4108f3cd63 req-d522c56f-10ea-49f3-a81a-d0ac2ae4ac65 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:15.921417 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-54594c8b-2d9f-465b-a0ac-9f4108f3cd63 req-d522c56f-10ea-49f3-a81a-d0ac2ae4ac65 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:15.948007 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-54594c8b-2d9f-465b-a0ac-9f4108f3cd63 req-d522c56f-10ea-49f3-a81a-d0ac2ae4ac65 service nova] Creating event network-vif-deleted:76e89343-401e-41b9-8e6d-0ed7a6b1167b for instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 on hv-cinder-83538 Jul 26 17:21:15.958361 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-54594c8b-2d9f-465b-a0ac-9f4108f3cd63 req-d522c56f-10ea-49f3-a81a-d0ac2ae4ac65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068391 Jul 26 17:21:15.959506 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 529/998] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:21:16.485467 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:16.488450 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:16.509460 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:16.510913 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:16.512485 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:16.513506 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:16.582987 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:16.583373 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:16.583781 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.objects.instance [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lazy-loading 'fault' on Instance uuid 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 {{(pid=118122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:21:16.691764 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:16.702149 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:16.704338 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab248df5c41d4495b9c9f46ef33c1631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250e4bed3c4c4c9c94a3143b2c6a7533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:16.706711 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-efb9b2cf-436e-4cd7-922e-badbb2ab9355 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 200 len: 1372 microversion: 2.20 time: 0.228231 Jul 26 17:21:16.707504 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 470/999] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:21:16 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 17:21:17.743292 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-19a28e78-5e98-464d-98a8-d0040ec54af5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:17.744730 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-19a28e78-5e98-464d-98a8-d0040ec54af5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:17.756191 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19a28e78-5e98-464d-98a8-d0040ec54af5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:17.757181 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19a28e78-5e98-464d-98a8-d0040ec54af5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:17.758724 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19a28e78-5e98-464d-98a8-d0040ec54af5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:17.759621 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19a28e78-5e98-464d-98a8-d0040ec54af5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:17.785882 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-19a28e78-5e98-464d-98a8-d0040ec54af5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] HTTP exception thrown: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-19a28e78-5e98-464d-98a8-d0040ec54af5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Request method failure captured: Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 HTTP/1.1 Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CC2-B6KfHOyz1rJ8CLd865021N5df4V3yafWv9Gr75q85K0u3Ak1k4gBQk36daeiaPwPHndI4-jWWmwwTlrAbcyCAgH8Thc8qaTLC2D2mDK0Lm5xo_ODCAgakRJA39CjmC3HD61JSG1Rrp_aemhXOqn7LJ-JrMryYau68Cr-JHC5EY Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 250e4bed3c4c4c9c94a3143b2c6a7533 Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:21:17.789635 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:21:17.791805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:21:17.791805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:17.791805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 250e4bed3c4c4c9c94a3143b2c6a7533 Jul 26 17:21:17.791805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:17.791805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeShelveTestJSON-157429425-project Jul 26 17:21:17.791805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:21:17.791805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:21:17.791805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: ab248df5c41d4495b9c9f46ef33c1631 Jul 26 17:21:17.791805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeShelveTestJSON-157429425-project Jul 26 17:21:17.791805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:21:17.791805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:17.791805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '09a85ce7-0ab6-4543-a87c-8231bde9c4b5'} Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:21:17.792685 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:17.794667 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:17.796111 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-19a28e78-5e98-464d-98a8-d0040ec54af5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Returning 404 to user: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:21:17.796111 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-19a28e78-5e98-464d-98a8-d0040ec54af5 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 404 len: 111 microversion: 2.20 time: 0.059131 Jul 26 17:21:17.796111 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 530/1000] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:21:17 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 17:21:17.808922 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-22346ad9-8e70-4b95-8e23-5045e4501591 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '.version_select at 0x7f6ca91b4670>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:17.819855 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR oslo.messaging._drivers.impl_rabbit [None req-22346ad9-8e70-4b95-8e23-5045e4501591 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [397424e0-d139-4c62-bc4f-7b95c2d0ea3e] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 17:21:18.832182 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO oslo.messaging._drivers.impl_rabbit [None req-22346ad9-8e70-4b95-8e23-5045e4501591 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [397424e0-d139-4c62-bc4f-7b95c2d0ea3e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 36174. Jul 26 17:21:18.858403 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-22346ad9-8e70-4b95-8e23-5045e4501591 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071824845" status: 204 len: 0 microversion: 2.20 time: 1.057876 Jul 26 17:21:18.864736 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 471/1001] 10.222.0.48 () {60 vars in 1262 bytes} [Tue Jul 26 17:21:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071824845 => generated 0 bytes in 1060 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 17:21:23.013826 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be8b0e3a-2434-48fe-a0f0-c76e279047b8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:23.019237 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be8b0e3a-2434-48fe-a0f0-c76e279047b8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:23.027384 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be8b0e3a-2434-48fe-a0f0-c76e279047b8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:23.027916 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be8b0e3a-2434-48fe-a0f0-c76e279047b8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:23.028774 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be8b0e3a-2434-48fe-a0f0-c76e279047b8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:23.029537 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be8b0e3a-2434-48fe-a0f0-c76e279047b8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:23.043883 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-be8b0e3a-2434-48fe-a0f0-c76e279047b8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] HTTP exception thrown: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be8b0e3a-2434-48fe-a0f0-c76e279047b8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Request method failure captured: Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 HTTP/1.1 Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CC2-B6KfHOyz1rJ8CLd865021N5df4V3yafWv9Gr75q85K0u3Ak1k4gBQk36daeiaPwPHndI4-jWWmwwTlrAbcyCAgH8Thc8qaTLC2D2mDK0Lm5xo_ODCAgakRJA39CjmC3HD61JSG1Rrp_aemhXOqn7LJ-JrMryYau68Cr-JHC5EY Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 250e4bed3c4c4c9c94a3143b2c6a7533 Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:21:23.045497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:21:23.046943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:21:23.046943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:23.046943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 250e4bed3c4c4c9c94a3143b2c6a7533 Jul 26 17:21:23.046943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:23.046943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeShelveTestJSON-157429425-project Jul 26 17:21:23.046943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:21:23.046943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:21:23.046943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: ab248df5c41d4495b9c9f46ef33c1631 Jul 26 17:21:23.046943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeShelveTestJSON-157429425-project Jul 26 17:21:23.046943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:21:23.046943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:23.046943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '09a85ce7-0ab6-4543-a87c-8231bde9c4b5'} Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:21:23.047722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:23.048936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:23.050262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be8b0e3a-2434-48fe-a0f0-c76e279047b8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Returning 404 to user: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:21:23.050262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be8b0e3a-2434-48fe-a0f0-c76e279047b8 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "DELETE /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 404 len: 111 microversion: 2.20 time: 0.038046 Jul 26 17:21:23.050262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 531/1002] 10.222.0.48 () {60 vars in 1280 bytes} [Tue Jul 26 17:21:23 2022] DELETE /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 17:21:23.056938 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f3efa725-4ed0-47eb-a64a-d48d57866977 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:23.057666 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-f3efa725-4ed0-47eb-a64a-d48d57866977 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 09a85ce7-0ab6-4543-a87c-8231bde9c4b5] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:23.060207 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:21:23.066205 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f3efa725-4ed0-47eb-a64a-d48d57866977 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:23.066637 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f3efa725-4ed0-47eb-a64a-d48d57866977 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:23.067427 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f3efa725-4ed0-47eb-a64a-d48d57866977 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:23.067864 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f3efa725-4ed0-47eb-a64a-d48d57866977 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:23.083162 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-f3efa725-4ed0-47eb-a64a-d48d57866977 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] HTTP exception thrown: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f3efa725-4ed0-47eb-a64a-d48d57866977 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Request method failure captured: Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 HTTP/1.1 Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CC2-B6KfHOyz1rJ8CLd865021N5df4V3yafWv9Gr75q85K0u3Ak1k4gBQk36daeiaPwPHndI4-jWWmwwTlrAbcyCAgH8Thc8qaTLC2D2mDK0Lm5xo_ODCAgakRJA39CjmC3HD61JSG1Rrp_aemhXOqn7LJ-JrMryYau68Cr-JHC5EY Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 250e4bed3c4c4c9c94a3143b2c6a7533 Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:21:23.084834 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:21:23.087526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:21:23.087526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:23.087526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 250e4bed3c4c4c9c94a3143b2c6a7533 Jul 26 17:21:23.087526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:23.087526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeShelveTestJSON-157429425-project Jul 26 17:21:23.087526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:21:23.087526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:21:23.087526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: ab248df5c41d4495b9c9f46ef33c1631 Jul 26 17:21:23.087526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-157429425-project Jul 26 17:21:23.087526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:21:23.087526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:23.087526 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '09a85ce7-0ab6-4543-a87c-8231bde9c4b5'} Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:21:23.088341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. Jul 26 17:21:23.089604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:21:23.090694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f3efa725-4ed0-47eb-a64a-d48d57866977 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Returning 404 to user: Instance 09a85ce7-0ab6-4543-a87c-8231bde9c4b5 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:21:23.090694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-f3efa725-4ed0-47eb-a64a-d48d57866977 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5" status: 404 len: 111 microversion: 2.20 time: 0.034702 Jul 26 17:21:23.090694 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 472/1003] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:21:23 2022] GET /compute/v2.1/servers/09a85ce7-0ab6-4543-a87c-8231bde9c4b5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 17:21:24.250976 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3417027c-d2db-485a-a293-595a81fe5906 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:24.251604 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3417027c-d2db-485a-a293-595a81fe5906 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:24.261310 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3417027c-d2db-485a-a293-595a81fe5906 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:24.261779 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3417027c-d2db-485a-a293-595a81fe5906 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:24.262575 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3417027c-d2db-485a-a293-595a81fe5906 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:24.263010 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3417027c-d2db-485a-a293-595a81fe5906 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:24.278361 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-3417027c-d2db-485a-a293-595a81fe5906 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] HTTP exception thrown: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3417027c-d2db-485a-a293-595a81fe5906 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Request method failure captured: Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 HTTP/1.1 Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CC2-B6KfHOyz1rJ8CLd865021N5df4V3yafWv9Gr75q85K0u3Ak1k4gBQk36daeiaPwPHndI4-jWWmwwTlrAbcyCAgH8Thc8qaTLC2D2mDK0Lm5xo_ODCAgakRJA39CjmC3HD61JSG1Rrp_aemhXOqn7LJ-JrMryYau68Cr-JHC5EY Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 250e4bed3c4c4c9c94a3143b2c6a7533 Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:21:24.279935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:21:24.281767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:21:24.281767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:24.281767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 250e4bed3c4c4c9c94a3143b2c6a7533 Jul 26 17:21:24.281767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:24.281767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeShelveTestJSON-157429425-project Jul 26 17:21:24.281767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:21:24.281767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:21:24.281767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: ab248df5c41d4495b9c9f46ef33c1631 Jul 26 17:21:24.281767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeShelveTestJSON-157429425-project Jul 26 17:21:24.281767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:21:24.281767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:21:24.281767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '0c7d66fd-65f0-4c03-8f1e-93d1ec23d411'} Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:21:24.285645 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:21:24.286893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:24.288219 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3417027c-d2db-485a-a293-595a81fe5906 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Returning 404 to user: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:21:24.288219 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3417027c-d2db-485a-a293-595a81fe5906 tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 404 len: 111 microversion: 2.20 time: 0.035248 Jul 26 17:21:24.288219 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 532/1004] 10.222.0.48 () {60 vars in 1280 bytes} [Tue Jul 26 17:21:24 2022] DELETE /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 17:21:24.290367 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ac5e0c2f-f0b7-4213-8791-09891992b4aa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:24.290984 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ac5e0c2f-f0b7-4213-8791-09891992b4aa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] [instance: 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:24.297491 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ac5e0c2f-f0b7-4213-8791-09891992b4aa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:24.298047 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ac5e0c2f-f0b7-4213-8791-09891992b4aa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:24.298823 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ac5e0c2f-f0b7-4213-8791-09891992b4aa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:24.299671 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ac5e0c2f-f0b7-4213-8791-09891992b4aa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:24.318693 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-ac5e0c2f-f0b7-4213-8791-09891992b4aa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] HTTP exception thrown: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ac5e0c2f-f0b7-4213-8791-09891992b4aa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Request method failure captured: Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 HTTP/1.1 Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CC2-B6KfHOyz1rJ8CLd865021N5df4V3yafWv9Gr75q85K0u3Ak1k4gBQk36daeiaPwPHndI4-jWWmwwTlrAbcyCAgH8Thc8qaTLC2D2mDK0Lm5xo_ODCAgakRJA39CjmC3HD61JSG1Rrp_aemhXOqn7LJ-JrMryYau68Cr-JHC5EY Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 250e4bed3c4c4c9c94a3143b2c6a7533 Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:21:24.321552 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:21:24.323422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/250e4bed3c4c4c9c94a3143b2c6a7533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:21:24.323422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:24.323422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 250e4bed3c4c4c9c94a3143b2c6a7533 Jul 26 17:21:24.323422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-157429425 Jul 26 17:21:24.323422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-AttachVolumeShelveTestJSON-157429425-project Jul 26 17:21:24.323422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:21:24.323422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:21:24.323422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: ab248df5c41d4495b9c9f46ef33c1631 Jul 26 17:21:24.323422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-157429425-project Jul 26 17:21:24.323422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:21:24.323422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:21:24.323422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '0c7d66fd-65f0-4c03-8f1e-93d1ec23d411'} Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:21:24.324519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. Jul 26 17:21:24.325901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:21:24.327758 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ac5e0c2f-f0b7-4213-8791-09891992b4aa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] Returning 404 to user: Instance 0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:21:24.327758 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ac5e0c2f-f0b7-4213-8791-09891992b4aa tempest-AttachVolumeShelveTestJSON-157429425 tempest-AttachVolumeShelveTestJSON-157429425-project] 10.222.0.48 "GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411" status: 404 len: 111 microversion: 2.20 time: 0.036667 Jul 26 17:21:24.327758 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 473/1005] 10.222.0.48 () {60 vars in 1277 bytes} [Tue Jul 26 17:21:24 2022] GET /compute/v2.1/servers/0c7d66fd-65f0-4c03-8f1e-93d1ec23d411 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 17:21:32.653373 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a1475456-53be-4909-b2bd-d7112c62e8b7 tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] Action: 'create', calling method: .version_select at 0x7f6ca8ad0ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1003015155", "metadata": {"Type": "work"}}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:21:33.303185 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a1475456-53be-4909-b2bd-d7112c62e8b7 tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.922287 Jul 26 17:21:33.304605 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 533/1006] 10.222.0.48 () {60 vars in 1156 bytes} [Tue Jul 26 17:21:32 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 926 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 17:21:33.323033 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-adf44ec6-7c6d-4013-9f8f-4009e3757e0c tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] Calling method '.version_select at 0x7f6ca91cfe50>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:33.428234 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-adf44ec6-7c6d-4013-9f8f-4009e3757e0c tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a" status: 200 len: 353 microversion: 2.1 time: 0.109431 Jul 26 17:21:33.431029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 474/1007] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:21:33 2022] GET /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:21:34.443803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:21:34.446319 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:21:34.453341 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e592553f-9608-497e-9a81-8d8fdbe1b66e tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] Calling method '.version_select at 0x7f6ca899f040>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:34.579080 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e592553f-9608-497e-9a81-8d8fdbe1b66e tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a" status: 200 len: 354 microversion: 2.1 time: 0.136447 Jul 26 17:21:34.586985 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 534/1008] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:21:34 2022] GET /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:21:34.592940 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=3 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:21:34.597077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=21 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:21:34.606012 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-16ec65de-e99d-40f5-9d35-d6ea65857b14 tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] Calling method '.version_select at 0x7f6ca91b4e50>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:34.693860 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-16ec65de-e99d-40f5-9d35-d6ea65857b14 tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a" status: 200 len: 354 microversion: 2.1 time: 0.103682 Jul 26 17:21:34.711213 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 475/1009] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:21:34 2022] GET /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:21:34.730222 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0456f639-de2a-4227-b7df-660ca598810d tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] Calling method '.version_select at 0x7f6ca8ab2430>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:34.864204 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0456f639-de2a-4227-b7df-660ca598810d tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a" status: 202 len: 0 microversion: 2.1 time: 0.146133 Jul 26 17:21:34.865845 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 535/1010] 10.222.0.48 () {58 vars in 1248 bytes} [Tue Jul 26 17:21:34 2022] DELETE /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:21:34.882681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1327f1c6-a278-4bb4-b063-4b0176554dd9 tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] Calling method '.version_select at 0x7f6ca91cf9d0>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:35.000456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1327f1c6-a278-4bb4-b063-4b0176554dd9 tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a" status: 200 len: 353 microversion: 2.1 time: 0.127100 Jul 26 17:21:35.002229 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 476/1011] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:21:34 2022] GET /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:21:36.019096 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9994b34b-447c-4237-be56-0dcc73447393 tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] Calling method '.version_select at 0x7f6ca8b67160>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:36.061265 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-9994b34b-447c-4237-be56-0dcc73447393 tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] HTTP exception thrown: Volume 1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a could not be found. Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9994b34b-447c-4237-be56-0dcc73447393 tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] Request method failure captured: Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a HTTP/1.1 Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CKc9FEcDhGAMvQeLOxCWHlrYEc-oiSBCvDmU01Uo6kpU1WWZ4ttK_w7h5Y_UBKgyGfL8wa3O8BAY8qaZxxU6uQLHOF7ME2JM56DrWv9HuXJrt6OluzyLFQTegV05FvDrq1EJEWvPA7t0KnP1iRCTg7N_s8m8rJFOourWoH0iYd0jME Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: e1141a0f81e94890a93c811444cfe9ec Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesGetTestJSON-1390432410 Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:21:36.063266 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e1141a0f81e94890a93c811444cfe9ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e1141a0f81e94890a93c811444cfe9ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e1141a0f81e94890a93c811444cfe9ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e1141a0f81e94890a93c811444cfe9ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesGetTestJSON-1390432410 Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: e1141a0f81e94890a93c811444cfe9ec Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesGetTestJSON-1390432410 Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesGetTestJSON-1390432410-project Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: 1a35e631f1374b4b806ae251b81b3c0b Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesGetTestJSON-1390432410-project Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Volume 1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a could not be found. Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a'} Jul 26 17:21:36.065015 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a could not be found. (HTTP 404) (Request-ID: req-b3dbae3f-41bb-4ad6-85f5-aaf7afc8433a) Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:36.066094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 17:21:36.067542 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a could not be found. Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 17:21:36.069001 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:21:36.071170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a could not be found. Jul 26 17:21:36.071170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:36.071170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:21:36.071170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:36.071170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:21:36.071170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:21:36.071170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:21:36.071170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:21:36.071170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:21:36.071170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a could not be found. Jul 26 17:21:36.071170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:21:36.073114 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9994b34b-447c-4237-be56-0dcc73447393 tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] Returning 404 to user: Volume 1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:21:36.074147 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9994b34b-447c-4237-be56-0dcc73447393 tempest-VolumesGetTestJSON-1390432410 tempest-VolumesGetTestJSON-1390432410-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a" status: 404 len: 109 microversion: 2.1 time: 0.060837 Jul 26 17:21:36.074729 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 536/1012] 10.222.0.48 () {58 vars in 1245 bytes} [Tue Jul 26 17:21:36 2022] GET /compute/v2.1/os-volumes/1ce741c6-3c0f-4d73-8e8c-f354ab4a1c7a => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:21:42.185261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-14c67def-5da3-438b-8ace-a12e4104fb93 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Action: 'create', calling method: .version_select at 0x7f6ca9127af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1454353036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx4GT59RxVc4eEcm6yzcY3lsEBtpXrUYvGny7sAsOtr6jev/SoJh+XZ8WZ6d/D2OoLwiHNPQ9odiGfJxIhQRc2aOl21OYvqrBNFrDMfwQSHjhcf3MwvD/il0fk1AIk8cQ=="}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:21:42.202941 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-14c67def-5da3-438b-8ace-a12e4104fb93 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Getting quotas for project 6bc7b7b99e854517a3a43d0b7f7b471a. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:21:42.207500 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.quota [None req-14c67def-5da3-438b-8ace-a12e4104fb93 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Getting quotas for user 154a6b37687d471da649a8f6727d751e and project 6bc7b7b99e854517a3a43d0b7f7b471a. Resources: {'key_pairs'} {{(pid=118122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:21:42.236162 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-14c67def-5da3-438b-8ace-a12e4104fb93 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055860 Jul 26 17:21:42.236763 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 477/1013] 10.222.0.48 () {60 vars in 1159 bytes} [Tue Jul 26 17:21:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:21:42.438609 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1617575373", "imageRef": "67af6b71-165a-42d3-b644-2bbf7b14b629", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1454353036", "networks": [{"uuid": "f5381c74-2f9f-4bc1-a0a8-54c3175037bb"}]}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:21:42.514356 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] validate_networks() for [('f5381c74-2f9f-4bc1-a0a8-54c3175037bb', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:21:42.951388 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:21:42.952045 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:21:42.952535 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:21:42.952943 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:21:42.953368 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:21:42.964480 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:42.967043 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:42.967043 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:42.967043 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:42.985886 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Getting quotas for project 6bc7b7b99e854517a3a43d0b7f7b471a. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:21:42.990666 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Getting quotas for user 154a6b37687d471da649a8f6727d751e and project 6bc7b7b99e854517a3a43d0b7f7b471a. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:21:43.012055 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:21:43.014350 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67af6b71-165a-42d3-b644-2bbf7b14b629',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:21:43.066629 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR oslo.messaging._drivers.impl_rabbit [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [c4c396e8-0ca5-4304-8585-16606e648f1e] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 17:21:44.075487 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [c4c396e8-0ca5-4304-8585-16606e648f1e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 36564. Jul 26 17:21:44.080196 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-111a2720-a7fd-4228-a9be-b29b0b523da0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.647041 Jul 26 17:21:44.080877 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 537/1014] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:21:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:21:44.094168 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9138e829-bb9c-43f0-965c-1c7e31507098 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:44.094918 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9138e829-bb9c-43f0-965c-1c7e31507098 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:44.152585 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9138e829-bb9c-43f0-965c-1c7e31507098 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:44.159577 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9138e829-bb9c-43f0-965c-1c7e31507098 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1259 microversion: 2.1 time: 0.069985 Jul 26 17:21:44.160906 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 478/1015] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:44 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:45.182276 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0c38e099-fef7-4b79-b01d-bc8cf2ca47b6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:45.182809 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0c38e099-fef7-4b79-b01d-bc8cf2ca47b6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:45.189499 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c38e099-fef7-4b79-b01d-bc8cf2ca47b6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:45.189948 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c38e099-fef7-4b79-b01d-bc8cf2ca47b6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:45.190702 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c38e099-fef7-4b79-b01d-bc8cf2ca47b6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:45.191128 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c38e099-fef7-4b79-b01d-bc8cf2ca47b6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:45.252368 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c38e099-fef7-4b79-b01d-bc8cf2ca47b6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:45.260660 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0c38e099-fef7-4b79-b01d-bc8cf2ca47b6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1311 microversion: 2.1 time: 0.083419 Jul 26 17:21:45.261262 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 538/1016] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:45 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:46.283434 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3aabc821-4bd1-4e2d-9416-5b827e8bbca3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:46.283961 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3aabc821-4bd1-4e2d-9416-5b827e8bbca3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:46.291209 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3aabc821-4bd1-4e2d-9416-5b827e8bbca3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:46.291662 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3aabc821-4bd1-4e2d-9416-5b827e8bbca3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:46.292429 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3aabc821-4bd1-4e2d-9416-5b827e8bbca3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:46.292859 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3aabc821-4bd1-4e2d-9416-5b827e8bbca3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:46.355062 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3aabc821-4bd1-4e2d-9416-5b827e8bbca3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:46.362500 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3aabc821-4bd1-4e2d-9416-5b827e8bbca3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1311 microversion: 2.1 time: 0.083014 Jul 26 17:21:46.363057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 479/1017] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:46 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:47.383593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c42335fe-5abd-479c-8933-abcdaca2ffb6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:47.384197 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c42335fe-5abd-479c-8933-abcdaca2ffb6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:47.390745 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c42335fe-5abd-479c-8933-abcdaca2ffb6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:47.391228 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c42335fe-5abd-479c-8933-abcdaca2ffb6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:47.391995 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c42335fe-5abd-479c-8933-abcdaca2ffb6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:47.392433 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c42335fe-5abd-479c-8933-abcdaca2ffb6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:47.455277 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c42335fe-5abd-479c-8933-abcdaca2ffb6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:47.463379 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c42335fe-5abd-479c-8933-abcdaca2ffb6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1311 microversion: 2.1 time: 0.084011 Jul 26 17:21:47.463935 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 539/1018] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:47 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:48.485015 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1bde0f8d-2937-4cf6-8e60-edaa0d92c148 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:48.485754 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1bde0f8d-2937-4cf6-8e60-edaa0d92c148 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:48.494336 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bde0f8d-2937-4cf6-8e60-edaa0d92c148 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:48.495148 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bde0f8d-2937-4cf6-8e60-edaa0d92c148 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:48.496179 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bde0f8d-2937-4cf6-8e60-edaa0d92c148 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:48.496849 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bde0f8d-2937-4cf6-8e60-edaa0d92c148 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:48.576042 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1bde0f8d-2937-4cf6-8e60-edaa0d92c148 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:48.585597 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1bde0f8d-2937-4cf6-8e60-edaa0d92c148 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1317 microversion: 2.1 time: 0.105045 Jul 26 17:21:48.589344 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 480/1019] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:48 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1317 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:49.608784 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-226ea141-b627-4cb6-a9ca-444965d41178 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:49.609501 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-226ea141-b627-4cb6-a9ca-444965d41178 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:49.616496 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-226ea141-b627-4cb6-a9ca-444965d41178 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:49.616938 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-226ea141-b627-4cb6-a9ca-444965d41178 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:49.617809 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-226ea141-b627-4cb6-a9ca-444965d41178 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:49.618245 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-226ea141-b627-4cb6-a9ca-444965d41178 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:49.768119 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-226ea141-b627-4cb6-a9ca-444965d41178 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:49.777804 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-226ea141-b627-4cb6-a9ca-444965d41178 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.172650 Jul 26 17:21:49.778330 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 540/1020] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:49 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:50.800258 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9a43f7f1-4d87-478c-a47d-c9f247a6283d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:50.800847 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9a43f7f1-4d87-478c-a47d-c9f247a6283d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:50.807803 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9a43f7f1-4d87-478c-a47d-c9f247a6283d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:50.808257 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9a43f7f1-4d87-478c-a47d-c9f247a6283d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:50.809093 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9a43f7f1-4d87-478c-a47d-c9f247a6283d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:50.809528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9a43f7f1-4d87-478c-a47d-c9f247a6283d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:50.957916 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9a43f7f1-4d87-478c-a47d-c9f247a6283d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:50.966588 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9a43f7f1-4d87-478c-a47d-c9f247a6283d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.170245 Jul 26 17:21:50.967751 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 481/1021] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:50 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:51.987583 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4ca46ad0-0ca7-43c5-b5ec-f8375665841c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:51.988167 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4ca46ad0-0ca7-43c5-b5ec-f8375665841c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:51.994756 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ca46ad0-0ca7-43c5-b5ec-f8375665841c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:51.995204 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ca46ad0-0ca7-43c5-b5ec-f8375665841c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:51.995963 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ca46ad0-0ca7-43c5-b5ec-f8375665841c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:51.996396 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ca46ad0-0ca7-43c5-b5ec-f8375665841c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:52.149030 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4ca46ad0-0ca7-43c5-b5ec-f8375665841c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:52.158260 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4ca46ad0-0ca7-43c5-b5ec-f8375665841c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.174386 Jul 26 17:21:52.159123 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 541/1022] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:51 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:53.182644 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-def25f0d-9fe6-4db6-9448-1557b14b96ff tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:53.184014 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-def25f0d-9fe6-4db6-9448-1557b14b96ff tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:53.191028 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-def25f0d-9fe6-4db6-9448-1557b14b96ff tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:53.191482 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-def25f0d-9fe6-4db6-9448-1557b14b96ff tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:53.192257 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-def25f0d-9fe6-4db6-9448-1557b14b96ff tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:53.192692 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-def25f0d-9fe6-4db6-9448-1557b14b96ff tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:53.348115 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-def25f0d-9fe6-4db6-9448-1557b14b96ff tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:53.366180 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-def25f0d-9fe6-4db6-9448-1557b14b96ff tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.188202 Jul 26 17:21:53.366909 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 482/1023] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:53 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:54.388588 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-570d7d48-732a-4c7d-a654-937a449d32aa tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:54.389518 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-570d7d48-732a-4c7d-a654-937a449d32aa tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:54.390983 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:21:54.392212 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=6 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:21:54.398608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-570d7d48-732a-4c7d-a654-937a449d32aa tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:54.399403 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-570d7d48-732a-4c7d-a654-937a449d32aa tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:54.400420 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-570d7d48-732a-4c7d-a654-937a449d32aa tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:54.401086 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-570d7d48-732a-4c7d-a654-937a449d32aa tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:54.563112 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-570d7d48-732a-4c7d-a654-937a449d32aa tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:54.571177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-570d7d48-732a-4c7d-a654-937a449d32aa tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.186815 Jul 26 17:21:54.572037 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 542/1024] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:54 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:21:55.591628 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-83eff234-784b-44e9-86b3-afb21aa4aaf5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:55.593072 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-83eff234-784b-44e9-86b3-afb21aa4aaf5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:55.596448 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=6 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:21:55.601508 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-83eff234-784b-44e9-86b3-afb21aa4aaf5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:55.602100 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-83eff234-784b-44e9-86b3-afb21aa4aaf5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:55.602960 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-83eff234-784b-44e9-86b3-afb21aa4aaf5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:55.603481 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-83eff234-784b-44e9-86b3-afb21aa4aaf5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:55.746539 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-83eff234-784b-44e9-86b3-afb21aa4aaf5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:55.761019 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-83eff234-784b-44e9-86b3-afb21aa4aaf5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.173064 Jul 26 17:21:55.762017 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 483/1025] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:55 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:21:56.783493 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3295b276-16ff-45ea-b1a1-a01e22f41b3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:56.784151 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3295b276-16ff-45ea-b1a1-a01e22f41b3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:56.791608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3295b276-16ff-45ea-b1a1-a01e22f41b3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:56.792052 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3295b276-16ff-45ea-b1a1-a01e22f41b3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:56.792822 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3295b276-16ff-45ea-b1a1-a01e22f41b3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:56.793289 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3295b276-16ff-45ea-b1a1-a01e22f41b3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:56.928425 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3295b276-16ff-45ea-b1a1-a01e22f41b3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:56.936301 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3295b276-16ff-45ea-b1a1-a01e22f41b3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.157253 Jul 26 17:21:56.936852 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 543/1026] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:56 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:21:57.957762 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-317c0ae7-531f-41e4-8afc-6b109dc51539 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:57.958392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-317c0ae7-531f-41e4-8afc-6b109dc51539 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:57.964921 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-317c0ae7-531f-41e4-8afc-6b109dc51539 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:57.965397 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-317c0ae7-531f-41e4-8afc-6b109dc51539 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:57.966168 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-317c0ae7-531f-41e4-8afc-6b109dc51539 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:57.966604 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-317c0ae7-531f-41e4-8afc-6b109dc51539 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:58.132118 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-317c0ae7-531f-41e4-8afc-6b109dc51539 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:58.140982 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-317c0ae7-531f-41e4-8afc-6b109dc51539 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.186904 Jul 26 17:21:58.142259 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 484/1027] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:57 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:21:58.143026 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-04854774-ffad-4ebe-8d85-b6d0f4015bbb req-4613afd5-bdff-469f-9bde-a0fa27208c70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674d4fc8-17c5-43c4-bde5-5db8d72cf80c", "tag": "b603904b-5bde-4d58-a55d-31697cdbd992"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:21:58.166359 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-04854774-ffad-4ebe-8d85-b6d0f4015bbb req-4613afd5-bdff-469f-9bde-a0fa27208c70 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:58.166831 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-04854774-ffad-4ebe-8d85-b6d0f4015bbb req-4613afd5-bdff-469f-9bde-a0fa27208c70 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:58.179388 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-04854774-ffad-4ebe-8d85-b6d0f4015bbb req-4613afd5-bdff-469f-9bde-a0fa27208c70 service nova] Creating event network-changed:b603904b-5bde-4d58-a55d-31697cdbd992 for instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c on hv-cinder-83538 Jul 26 17:21:58.186067 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-04854774-ffad-4ebe-8d85-b6d0f4015bbb req-4613afd5-bdff-469f-9bde-a0fa27208c70 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058923 Jul 26 17:21:58.187388 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 544/1028] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:21:59.165712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-03d04fa4-b99c-44e3-99fc-bc4b397da64c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:21:59.166318 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-03d04fa4-b99c-44e3-99fc-bc4b397da64c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:21:59.173191 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-03d04fa4-b99c-44e3-99fc-bc4b397da64c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:59.173643 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-03d04fa4-b99c-44e3-99fc-bc4b397da64c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:59.174425 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-03d04fa4-b99c-44e3-99fc-bc4b397da64c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:21:59.174866 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-03d04fa4-b99c-44e3-99fc-bc4b397da64c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:21:59.313095 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-03d04fa4-b99c-44e3-99fc-bc4b397da64c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:21:59.321127 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-03d04fa4-b99c-44e3-99fc-bc4b397da64c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.161524 Jul 26 17:21:59.321724 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 485/1029] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:21:59 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:00.344507 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5fccddf2-d878-46dd-b6f5-aa438e668502 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:00.345247 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5fccddf2-d878-46dd-b6f5-aa438e668502 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:00.352903 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5fccddf2-d878-46dd-b6f5-aa438e668502 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:00.353388 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5fccddf2-d878-46dd-b6f5-aa438e668502 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:00.354179 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5fccddf2-d878-46dd-b6f5-aa438e668502 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:00.354617 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5fccddf2-d878-46dd-b6f5-aa438e668502 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:00.499949 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5fccddf2-d878-46dd-b6f5-aa438e668502 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:00.508310 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5fccddf2-d878-46dd-b6f5-aa438e668502 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.168526 Jul 26 17:22:00.508889 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 545/1030] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:00 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:01.529232 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6e89972b-7f91-4cdb-8840-44dcd658f726 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:01.529879 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6e89972b-7f91-4cdb-8840-44dcd658f726 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:01.536557 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6e89972b-7f91-4cdb-8840-44dcd658f726 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:01.537564 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6e89972b-7f91-4cdb-8840-44dcd658f726 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:01.538803 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6e89972b-7f91-4cdb-8840-44dcd658f726 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:01.539242 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6e89972b-7f91-4cdb-8840-44dcd658f726 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:01.675173 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6e89972b-7f91-4cdb-8840-44dcd658f726 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:01.683422 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6e89972b-7f91-4cdb-8840-44dcd658f726 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.158104 Jul 26 17:22:01.683991 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 486/1031] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:01 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:02.704839 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5954db6d-7de8-47bc-9810-909f0a59398b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:02.706376 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5954db6d-7de8-47bc-9810-909f0a59398b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:02.714152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5954db6d-7de8-47bc-9810-909f0a59398b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:02.715031 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5954db6d-7de8-47bc-9810-909f0a59398b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:02.716334 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5954db6d-7de8-47bc-9810-909f0a59398b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:02.718177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5954db6d-7de8-47bc-9810-909f0a59398b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:02.870094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5954db6d-7de8-47bc-9810-909f0a59398b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:02.878068 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5954db6d-7de8-47bc-9810-909f0a59398b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.177618 Jul 26 17:22:02.878842 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 546/1032] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:02 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:03.899771 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-dd71ffb4-9922-4368-a8c2-49a5a201110a tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:03.900304 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-dd71ffb4-9922-4368-a8c2-49a5a201110a tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:03.907068 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dd71ffb4-9922-4368-a8c2-49a5a201110a tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:03.907752 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dd71ffb4-9922-4368-a8c2-49a5a201110a tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:03.908525 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dd71ffb4-9922-4368-a8c2-49a5a201110a tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:03.908982 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-dd71ffb4-9922-4368-a8c2-49a5a201110a tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:04.049424 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-dd71ffb4-9922-4368-a8c2-49a5a201110a tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:04.058392 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-dd71ffb4-9922-4368-a8c2-49a5a201110a tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.163020 Jul 26 17:22:04.058959 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 487/1033] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:03 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:04.093427 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-a74ca91a-9d6d-4adb-a225-2836d8fb3605 req-0065c9d7-06cf-4628-86cc-baa71c7077e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674d4fc8-17c5-43c4-bde5-5db8d72cf80c", "name": "network-vif-plugged", "status": "completed", "tag": "b603904b-5bde-4d58-a55d-31697cdbd992"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:22:04.105204 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-a74ca91a-9d6d-4adb-a225-2836d8fb3605 req-0065c9d7-06cf-4628-86cc-baa71c7077e2 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:04.106404 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-a74ca91a-9d6d-4adb-a225-2836d8fb3605 req-0065c9d7-06cf-4628-86cc-baa71c7077e2 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:04.119570 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-a74ca91a-9d6d-4adb-a225-2836d8fb3605 req-0065c9d7-06cf-4628-86cc-baa71c7077e2 service nova] Creating event network-vif-plugged:b603904b-5bde-4d58-a55d-31697cdbd992 for instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c on hv-cinder-83538 Jul 26 17:22:04.125396 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-a74ca91a-9d6d-4adb-a225-2836d8fb3605 req-0065c9d7-06cf-4628-86cc-baa71c7077e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035907 Jul 26 17:22:04.126094 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 547/1034] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:22:05.079467 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7e406e67-d53a-43fc-b41b-1973eabcade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:05.080082 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7e406e67-d53a-43fc-b41b-1973eabcade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:05.085957 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:05.088148 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7e406e67-d53a-43fc-b41b-1973eabcade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:05.088713 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7e406e67-d53a-43fc-b41b-1973eabcade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:05.089611 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7e406e67-d53a-43fc-b41b-1973eabcade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:05.090072 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7e406e67-d53a-43fc-b41b-1973eabcade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:05.231529 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7e406e67-d53a-43fc-b41b-1973eabcade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:05.246020 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7e406e67-d53a-43fc-b41b-1973eabcade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.170151 Jul 26 17:22:05.246766 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 488/1035] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:05 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:06.269182 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1a0d6093-af0a-4f47-8442-db50e03ef9ba tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:06.270032 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1a0d6093-af0a-4f47-8442-db50e03ef9ba tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:06.272651 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:06.278805 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a0d6093-af0a-4f47-8442-db50e03ef9ba tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:06.279331 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a0d6093-af0a-4f47-8442-db50e03ef9ba tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:06.280978 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a0d6093-af0a-4f47-8442-db50e03ef9ba tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:06.281444 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a0d6093-af0a-4f47-8442-db50e03ef9ba tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:06.286432 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=55 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:06.417970 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1a0d6093-af0a-4f47-8442-db50e03ef9ba tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:06.425371 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1a0d6093-af0a-4f47-8442-db50e03ef9ba tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.160925 Jul 26 17:22:06.425925 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 548/1036] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:06 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:07.446015 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-a2c79fde-e986-424b-92d4-4456542bedf1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:07.446605 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-a2c79fde-e986-424b-92d4-4456542bedf1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:07.454453 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a2c79fde-e986-424b-92d4-4456542bedf1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:07.454900 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a2c79fde-e986-424b-92d4-4456542bedf1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:07.455680 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a2c79fde-e986-424b-92d4-4456542bedf1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:07.456122 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-a2c79fde-e986-424b-92d4-4456542bedf1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:07.592551 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-a2c79fde-e986-424b-92d4-4456542bedf1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:07.601462 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-a2c79fde-e986-424b-92d4-4456542bedf1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.159271 Jul 26 17:22:07.602036 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 489/1037] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:07 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:08.623556 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f93c9f62-84f4-4b50-99b7-e0e698377d7e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:08.624180 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f93c9f62-84f4-4b50-99b7-e0e698377d7e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:08.634081 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f93c9f62-84f4-4b50-99b7-e0e698377d7e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:08.634548 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f93c9f62-84f4-4b50-99b7-e0e698377d7e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:08.635344 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f93c9f62-84f4-4b50-99b7-e0e698377d7e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:08.635787 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f93c9f62-84f4-4b50-99b7-e0e698377d7e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:08.789196 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f93c9f62-84f4-4b50-99b7-e0e698377d7e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:08.797536 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f93c9f62-84f4-4b50-99b7-e0e698377d7e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1359 microversion: 2.1 time: 0.178648 Jul 26 17:22:08.798243 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 549/1038] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:08 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:09.820750 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1bacf34a-3077-4439-8256-f56c0f943d11 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:09.821510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1bacf34a-3077-4439-8256-f56c0f943d11 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:09.827559 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bacf34a-3077-4439-8256-f56c0f943d11 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:09.828009 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bacf34a-3077-4439-8256-f56c0f943d11 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:09.828782 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bacf34a-3077-4439-8256-f56c0f943d11 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:09.829250 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1bacf34a-3077-4439-8256-f56c0f943d11 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:09.967236 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1bacf34a-3077-4439-8256-f56c0f943d11 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:09.975007 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1bacf34a-3077-4439-8256-f56c0f943d11 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1550 microversion: 2.1 time: 0.160107 Jul 26 17:22:09.975571 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 490/1039] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:09 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:09.995775 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-536d576a-ed5d-4972-abcb-5821b4ad48e7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:09.996389 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-536d576a-ed5d-4972-abcb-5821b4ad48e7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:10.003236 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-536d576a-ed5d-4972-abcb-5821b4ad48e7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:10.003672 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-536d576a-ed5d-4972-abcb-5821b4ad48e7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:10.004474 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-536d576a-ed5d-4972-abcb-5821b4ad48e7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:10.004912 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-536d576a-ed5d-4972-abcb-5821b4ad48e7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:10.145486 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-536d576a-ed5d-4972-abcb-5821b4ad48e7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:10.153278 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-536d576a-ed5d-4972-abcb-5821b4ad48e7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1550 microversion: 2.1 time: 0.161317 Jul 26 17:22:10.153881 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 550/1040] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:09 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:10.174419 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-85959227-1862-47c3-a99d-e7336b9dade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:10.180161 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-85959227-1862-47c3-a99d-e7336b9dade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:10.180830 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-85959227-1862-47c3-a99d-e7336b9dade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Searching by: {'deleted': False, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a'} {{(pid=118122) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 17:22:10.187602 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-85959227-1862-47c3-a99d-e7336b9dade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:10.188050 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-85959227-1862-47c3-a99d-e7336b9dade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:10.188844 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-85959227-1862-47c3-a99d-e7336b9dade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:10.189312 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-85959227-1862-47c3-a99d-e7336b9dade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:10.286247 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.multi_cell_list [None req-85959227-1862-47c3-a99d-e7336b9dade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118122) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 17:22:10.381571 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-85959227-1862-47c3-a99d-e7336b9dade3 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210715 Jul 26 17:22:10.382089 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 491/1041] 10.222.0.48 () {58 vars in 1125 bytes} [Tue Jul 26 17:22:10 2022] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:22:10.393489 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0f1861b9-7010-40f3-9dc2-1e29bb967688 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:10.394097 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0f1861b9-7010-40f3-9dc2-1e29bb967688 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:10.400338 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f1861b9-7010-40f3-9dc2-1e29bb967688 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:10.400793 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f1861b9-7010-40f3-9dc2-1e29bb967688 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:10.401593 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f1861b9-7010-40f3-9dc2-1e29bb967688 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:10.402029 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f1861b9-7010-40f3-9dc2-1e29bb967688 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:10.540099 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0f1861b9-7010-40f3-9dc2-1e29bb967688 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:10.547708 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0f1861b9-7010-40f3-9dc2-1e29bb967688 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1550 microversion: 2.1 time: 0.158159 Jul 26 17:22:10.548282 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 551/1042] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:10 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:12.113559 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-4bd7dca8-e3ec-46e3-aa9f-d60c96795139 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1beeb385-4772-4ee5-8273-5961bb99b453"}} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:22:12.116623 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-4bd7dca8-e3ec-46e3-aa9f-d60c96795139 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:12.123316 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4bd7dca8-e3ec-46e3-aa9f-d60c96795139 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:12.123763 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4bd7dca8-e3ec-46e3-aa9f-d60c96795139 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:12.124530 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4bd7dca8-e3ec-46e3-aa9f-d60c96795139 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:12.124978 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-4bd7dca8-e3ec-46e3-aa9f-d60c96795139 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:12.411092 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-4bd7dca8-e3ec-46e3-aa9f-d60c96795139 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "POST /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301514 Jul 26 17:22:12.411732 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 492/1043] 10.222.0.48 () {60 vars in 1323 bytes} [Tue Jul 26 17:22:12 2022] POST /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:22:20.058440 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b0230ce7-7bec-4593-af5f-994925cfed3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:20.059072 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b0230ce7-7bec-4593-af5f-994925cfed3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:20.066403 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0230ce7-7bec-4593-af5f-994925cfed3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:20.066856 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0230ce7-7bec-4593-af5f-994925cfed3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:20.068535 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0230ce7-7bec-4593-af5f-994925cfed3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:20.069945 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0230ce7-7bec-4593-af5f-994925cfed3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:20.218100 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b0230ce7-7bec-4593-af5f-994925cfed3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:20.226765 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b0230ce7-7bec-4593-af5f-994925cfed3d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1596 microversion: 2.1 time: 0.172305 Jul 26 17:22:20.227338 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 552/1044] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:20 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1596 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:22.205717 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:22.206872 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=9 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:22.213835 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-5fa2b40c-8073-46f7-9a24-eec29aa7960b req-194a3568-e11f-4660-b3ee-a0dbf78f7aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674d4fc8-17c5-43c4-bde5-5db8d72cf80c", "tag": "b603904b-5bde-4d58-a55d-31697cdbd992"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:22:22.226812 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-5fa2b40c-8073-46f7-9a24-eec29aa7960b req-194a3568-e11f-4660-b3ee-a0dbf78f7aef service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:22.227406 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-5fa2b40c-8073-46f7-9a24-eec29aa7960b req-194a3568-e11f-4660-b3ee-a0dbf78f7aef service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:22.240273 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:22.243172 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-5fa2b40c-8073-46f7-9a24-eec29aa7960b req-194a3568-e11f-4660-b3ee-a0dbf78f7aef service nova] Creating event network-changed:b603904b-5bde-4d58-a55d-31697cdbd992 for instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c on hv-cinder-83538 Jul 26 17:22:22.250538 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-5fa2b40c-8073-46f7-9a24-eec29aa7960b req-194a3568-e11f-4660-b3ee-a0dbf78f7aef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045908 Jul 26 17:22:22.256307 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 493/1045] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:22:23.370907 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7addfc58-c351-47a9-b793-e36d021366d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-255477186"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:22:23.371491 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7addfc58-c351-47a9-b793-e36d021366d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:23.378960 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7addfc58-c351-47a9-b793-e36d021366d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:23.379413 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7addfc58-c351-47a9-b793-e36d021366d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:23.381130 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7addfc58-c351-47a9-b793-e36d021366d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:23.381586 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7addfc58-c351-47a9-b793-e36d021366d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:23.513287 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.network.security_group_api [None req-7addfc58-c351-47a9-b793-e36d021366d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Adding security group 1fdc36a1-c2a4-4127-b834-399d561bc4a3 to port b603904b-5bde-4d58-a55d-31697cdbd992 Jul 26 17:22:23.869100 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7addfc58-c351-47a9-b793-e36d021366d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "POST /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/action" status: 202 len: 0 microversion: 2.1 time: 0.502083 Jul 26 17:22:23.875766 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 553/1046] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:22:23 2022] POST /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:22:23.880848 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-3770f020-a246-4980-b965-bf210be14454 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:23.882331 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-3770f020-a246-4980-b965-bf210be14454 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:23.890624 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3770f020-a246-4980-b965-bf210be14454 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:23.891313 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3770f020-a246-4980-b965-bf210be14454 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:23.892277 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3770f020-a246-4980-b965-bf210be14454 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:23.892720 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-3770f020-a246-4980-b965-bf210be14454 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:24.065408 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-3770f020-a246-4980-b965-bf210be14454 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:24.074419 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-3770f020-a246-4980-b965-bf210be14454 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1760 microversion: 2.1 time: 0.199484 Jul 26 17:22:24.075148 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 494/1047] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:23 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1760 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:24.268781 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-b5cef8df-4dc1-40cc-a61b-b8e92e0bde40 req-1a66e7c7-882c-4437-83bc-2d0266ab05e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674d4fc8-17c5-43c4-bde5-5db8d72cf80c", "tag": "b603904b-5bde-4d58-a55d-31697cdbd992"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:22:24.281433 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-b5cef8df-4dc1-40cc-a61b-b8e92e0bde40 req-1a66e7c7-882c-4437-83bc-2d0266ab05e9 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:24.282032 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-b5cef8df-4dc1-40cc-a61b-b8e92e0bde40 req-1a66e7c7-882c-4437-83bc-2d0266ab05e9 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:24.300055 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-b5cef8df-4dc1-40cc-a61b-b8e92e0bde40 req-1a66e7c7-882c-4437-83bc-2d0266ab05e9 service nova] Creating event network-changed:b603904b-5bde-4d58-a55d-31697cdbd992 for instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c on hv-cinder-83538 Jul 26 17:22:24.310177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-b5cef8df-4dc1-40cc-a61b-b8e92e0bde40 req-1a66e7c7-882c-4437-83bc-2d0266ab05e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044500 Jul 26 17:22:24.310995 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 554/1048] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:22:29.730252 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c01ee814-7ac5-43c2-8bd8-e575872ec7ab tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:29.730935 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c01ee814-7ac5-43c2-8bd8-e575872ec7ab tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:29.733084 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-a3ad67ec-0c2e-4aa7-802c-131b19492ce3 req-64badbe3-4519-400d-9c09-e8453308f74c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b93f34-9005-40dc-acb1-496c1eaf53c6", "tag": "106ac6cf-a172-4113-980c-418b8d51f6a4"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:22:29.737904 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c01ee814-7ac5-43c2-8bd8-e575872ec7ab tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:29.738577 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c01ee814-7ac5-43c2-8bd8-e575872ec7ab tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:29.740053 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c01ee814-7ac5-43c2-8bd8-e575872ec7ab tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:29.740495 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c01ee814-7ac5-43c2-8bd8-e575872ec7ab tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:29.745606 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-a3ad67ec-0c2e-4aa7-802c-131b19492ce3 req-64badbe3-4519-400d-9c09-e8453308f74c service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:29.746064 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-a3ad67ec-0c2e-4aa7-802c-131b19492ce3 req-64badbe3-4519-400d-9c09-e8453308f74c service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:29.759954 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-a3ad67ec-0c2e-4aa7-802c-131b19492ce3 req-64badbe3-4519-400d-9c09-e8453308f74c service nova] Creating event network-changed:106ac6cf-a172-4113-980c-418b8d51f6a4 for instance 95b93f34-9005-40dc-acb1-496c1eaf53c6 on hv-cinder-83538 Jul 26 17:22:29.765462 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-a3ad67ec-0c2e-4aa7-802c-131b19492ce3 req-64badbe3-4519-400d-9c09-e8453308f74c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036162 Jul 26 17:22:29.766538 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 555/1049] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:22:29.769388 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c01ee814-7ac5-43c2-8bd8-e575872ec7ab tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Going to try to terminate instance {{(pid=118122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:22:29.866711 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c01ee814-7ac5-43c2-8bd8-e575872ec7ab tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "DELETE /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 204 len: 0 microversion: 2.1 time: 0.140758 Jul 26 17:22:29.867418 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 495/1050] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:22:29 2022] DELETE /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:22:29.876861 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-53946815-9d5c-4157-97b7-98e4485416ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:29.877738 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-53946815-9d5c-4157-97b7-98e4485416ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:29.887219 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53946815-9d5c-4157-97b7-98e4485416ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:29.887841 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53946815-9d5c-4157-97b7-98e4485416ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:29.888741 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53946815-9d5c-4157-97b7-98e4485416ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:29.889522 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53946815-9d5c-4157-97b7-98e4485416ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:30.055054 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-53946815-9d5c-4157-97b7-98e4485416ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:30.063497 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-53946815-9d5c-4157-97b7-98e4485416ae tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.191314 Jul 26 17:22:30.064188 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 556/1051] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:29 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:22:31.086054 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-378fc9f5-8061-45d6-858f-b85b0ba49a93 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:31.086765 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-378fc9f5-8061-45d6-858f-b85b0ba49a93 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:31.093431 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-378fc9f5-8061-45d6-858f-b85b0ba49a93 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:31.094438 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-378fc9f5-8061-45d6-858f-b85b0ba49a93 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:31.094910 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-378fc9f5-8061-45d6-858f-b85b0ba49a93 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:31.095231 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-378fc9f5-8061-45d6-858f-b85b0ba49a93 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:31.242607 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-378fc9f5-8061-45d6-858f-b85b0ba49a93 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:31.250516 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-378fc9f5-8061-45d6-858f-b85b0ba49a93 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1568 microversion: 2.1 time: 0.168870 Jul 26 17:22:31.251375 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 496/1052] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:31 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:32.271974 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e3d99bc3-c6e8-4ad0-af8a-95e699ae3547 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:32.272601 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e3d99bc3-c6e8-4ad0-af8a-95e699ae3547 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:32.280046 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3d99bc3-c6e8-4ad0-af8a-95e699ae3547 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:32.280500 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3d99bc3-c6e8-4ad0-af8a-95e699ae3547 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:32.281357 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3d99bc3-c6e8-4ad0-af8a-95e699ae3547 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:32.281782 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3d99bc3-c6e8-4ad0-af8a-95e699ae3547 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:32.553962 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-d3102ec8-97fe-4a11-b00a-aafec620543a req-b2ebe2f5-d800-4502-838a-6766caf6f88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b93f34-9005-40dc-acb1-496c1eaf53c6", "name": "network-vif-deleted", "tag": "106ac6cf-a172-4113-980c-418b8d51f6a4"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:22:32.559736 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e3d99bc3-c6e8-4ad0-af8a-95e699ae3547 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd84cca5fc64f46109e9e62394da12437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a543d5eb6ef45569e57965779e4753e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:32.570843 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-d3102ec8-97fe-4a11-b00a-aafec620543a req-b2ebe2f5-d800-4502-838a-6766caf6f88d service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:32.571286 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-d3102ec8-97fe-4a11-b00a-aafec620543a req-b2ebe2f5-d800-4502-838a-6766caf6f88d service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:32.573461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e3d99bc3-c6e8-4ad0-af8a-95e699ae3547 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 200 len: 1449 microversion: 2.1 time: 0.305166 Jul 26 17:22:32.575835 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 557/1053] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:32 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 1449 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:32.604752 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-d3102ec8-97fe-4a11-b00a-aafec620543a req-b2ebe2f5-d800-4502-838a-6766caf6f88d service nova] Creating event network-vif-deleted:106ac6cf-a172-4113-980c-418b8d51f6a4 for instance 95b93f34-9005-40dc-acb1-496c1eaf53c6 on hv-cinder-83538 Jul 26 17:22:32.615082 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-d3102ec8-97fe-4a11-b00a-aafec620543a req-b2ebe2f5-d800-4502-838a-6766caf6f88d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067344 Jul 26 17:22:32.616111 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 497/1054] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:22:33.602725 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b3f72352-a34b-4dae-9bff-0d60059891bb tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:33.603278 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b3f72352-a34b-4dae-9bff-0d60059891bb tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] [instance: 95b93f34-9005-40dc-acb1-496c1eaf53c6] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:33.610807 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3f72352-a34b-4dae-9bff-0d60059891bb tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:33.611267 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3f72352-a34b-4dae-9bff-0d60059891bb tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:33.612030 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3f72352-a34b-4dae-9bff-0d60059891bb tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:33.612460 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3f72352-a34b-4dae-9bff-0d60059891bb tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:33.627423 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-b3f72352-a34b-4dae-9bff-0d60059891bb tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] HTTP exception thrown: Instance 95b93f34-9005-40dc-acb1-496c1eaf53c6 could not be found. Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b3f72352-a34b-4dae-9bff-0d60059891bb tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Request method failure captured: Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 HTTP/1.1 Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CGLJlHGre0h8U9UD3b4WVerhhpPJheLweg7tMXvRItYc275mhAtwwACcWvZ2wL7hoR5z6mmK2K3ahRlvL2GMaYNPRmHsNeoQjW1bqTagSkaD0WOQN3c0L-GXryus-JMGLaLF6SR7KY2cjJnKPVm97iaRZsc4LesB55XEYHVKZ2mt00 Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 0a543d5eb6ef45569e57965779e4753e Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-TestShelveInstance-1314312445 Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:22:33.629658 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:22:33.631806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a543d5eb6ef45569e57965779e4753e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a543d5eb6ef45569e57965779e4753e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a543d5eb6ef45569e57965779e4753e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a543d5eb6ef45569e57965779e4753e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:22:33.631806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-TestShelveInstance-1314312445 Jul 26 17:22:33.631806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 0a543d5eb6ef45569e57965779e4753e Jul 26 17:22:33.631806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-TestShelveInstance-1314312445 Jul 26 17:22:33.631806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-TestShelveInstance-1314312445-project Jul 26 17:22:33.631806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:22:33.631806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:22:33.631806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: d84cca5fc64f46109e9e62394da12437 Jul 26 17:22:33.631806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-TestShelveInstance-1314312445-project Jul 26 17:22:33.631806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:22:33.631806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance 95b93f34-9005-40dc-acb1-496c1eaf53c6 could not be found. Jul 26 17:22:33.631806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '95b93f34-9005-40dc-acb1-496c1eaf53c6'} Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b93f34-9005-40dc-acb1-496c1eaf53c6 could not be found. Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:22:33.633131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b93f34-9005-40dc-acb1-496c1eaf53c6 could not be found. Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b93f34-9005-40dc-acb1-496c1eaf53c6 could not be found. Jul 26 17:22:33.635392 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:22:33.637830 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b3f72352-a34b-4dae-9bff-0d60059891bb tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Returning 404 to user: Instance 95b93f34-9005-40dc-acb1-496c1eaf53c6 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:22:33.637830 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b3f72352-a34b-4dae-9bff-0d60059891bb tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6" status: 404 len: 111 microversion: 2.1 time: 0.032543 Jul 26 17:22:33.637830 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 558/1055] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:33 2022] GET /compute/v2.1/servers/95b93f34-9005-40dc-acb1-496c1eaf53c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:22:33.889666 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-e35c2653-a72d-4f92-8b2f-6bbe5abc19d6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] Calling method '.version_select at 0x7f6ca92883a0>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:33.911931 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-e35c2653-a72d-4f92-8b2f-6bbe5abc19d6 tempest-TestShelveInstance-1314312445 tempest-TestShelveInstance-1314312445-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-391504489" status: 202 len: 0 microversion: 2.1 time: 0.026930 Jul 26 17:22:33.912657 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 498/1056] 10.222.0.48 () {58 vars in 1251 bytes} [Tue Jul 26 17:22:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-391504489 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:22:34.641191 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1504090570", "imageRef": "bf942f75-add1-4741-8aa6-98c33b3ff04d", "flavorRef": "452"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:22:34.710036 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] validate_networks() for None {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:22:35.132455 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:22:35.132889 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:22:35.133374 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:22:35.133803 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:22:35.134186 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:22:35.143885 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:35.144330 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:35.146451 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:35.146904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:35.165604 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Getting quotas for project 00a1957117fc4a8497f01474d163fae0. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:22:35.171199 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Getting quotas for user 7f56196da2cd48dfb831994871e127be and project 00a1957117fc4a8497f01474d163fae0. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:22:35.183396 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:22:35.186456 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf942f75-add1-4741-8aa6-98c33b3ff04d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:22:35.243208 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-71e319bb-3e46-4f9b-9872-178bfae00129 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606073 Jul 26 17:22:35.244247 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 559/1057] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:22:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:22:35.263828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-764a82b7-6f70-4144-ad3d-dd3fb62a759b tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:35.265120 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-764a82b7-6f70-4144-ad3d-dd3fb62a759b tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:35.348121 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-764a82b7-6f70-4144-ad3d-dd3fb62a759b tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:35.358314 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-764a82b7-6f70-4144-ad3d-dd3fb62a759b tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1215 microversion: 2.1 time: 0.101396 Jul 26 17:22:35.359620 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 499/1058] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:35 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:36.386084 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-af38f749-0ac1-4b54-8107-ab5089b8e203 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:36.388212 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-af38f749-0ac1-4b54-8107-ab5089b8e203 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:36.392821 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:36.408499 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af38f749-0ac1-4b54-8107-ab5089b8e203 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:36.410644 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af38f749-0ac1-4b54-8107-ab5089b8e203 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:36.412395 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af38f749-0ac1-4b54-8107-ab5089b8e203 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:36.413627 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af38f749-0ac1-4b54-8107-ab5089b8e203 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:36.421019 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=54 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:36.561151 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-af38f749-0ac1-4b54-8107-ab5089b8e203 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:36.584409 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-af38f749-0ac1-4b54-8107-ab5089b8e203 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1275 microversion: 2.1 time: 0.204630 Jul 26 17:22:36.587200 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 560/1059] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:36 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:22:37.622879 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2d00363b-b774-4500-8758-7d06f5571e14 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:37.625029 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2d00363b-b774-4500-8758-7d06f5571e14 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:37.641056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2d00363b-b774-4500-8758-7d06f5571e14 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:37.641763 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2d00363b-b774-4500-8758-7d06f5571e14 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:37.642691 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2d00363b-b774-4500-8758-7d06f5571e14 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:37.643144 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2d00363b-b774-4500-8758-7d06f5571e14 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:37.793954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-2d00363b-b774-4500-8758-7d06f5571e14 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:37.806581 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2d00363b-b774-4500-8758-7d06f5571e14 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1273 microversion: 2.1 time: 0.192787 Jul 26 17:22:37.807939 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 500/1060] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:37 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:38.831126 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-383919a9-8090-42a8-b6df-fc1c280d34eb tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:38.831751 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-383919a9-8090-42a8-b6df-fc1c280d34eb tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:38.840556 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-383919a9-8090-42a8-b6df-fc1c280d34eb tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:38.841039 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-383919a9-8090-42a8-b6df-fc1c280d34eb tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:38.842537 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-383919a9-8090-42a8-b6df-fc1c280d34eb tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:38.843012 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-383919a9-8090-42a8-b6df-fc1c280d34eb tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:39.149343 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-5b3c11a3-8ed6-4a98-bd17-7ed50aa807f0 req-608b33cb-f070-4458-9e20-f1cf97d79f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25815535-2905-4c19-af09-3b0e450f11e1", "tag": "25acfa16-3ffc-4e7d-8e58-354333aac6ea"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:22:39.173336 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-383919a9-8090-42a8-b6df-fc1c280d34eb tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:39.174039 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-5b3c11a3-8ed6-4a98-bd17-7ed50aa807f0 req-608b33cb-f070-4458-9e20-f1cf97d79f2c service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:39.174474 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-5b3c11a3-8ed6-4a98-bd17-7ed50aa807f0 req-608b33cb-f070-4458-9e20-f1cf97d79f2c service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:39.189158 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-5b3c11a3-8ed6-4a98-bd17-7ed50aa807f0 req-608b33cb-f070-4458-9e20-f1cf97d79f2c service nova] Creating event network-changed:25acfa16-3ffc-4e7d-8e58-354333aac6ea for instance 25815535-2905-4c19-af09-3b0e450f11e1 on hv-cinder-83538 Jul 26 17:22:39.189668 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-383919a9-8090-42a8-b6df-fc1c280d34eb tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1315 microversion: 2.1 time: 0.361852 Jul 26 17:22:39.193701 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 561/1061] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:38 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:22:39.202408 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-5b3c11a3-8ed6-4a98-bd17-7ed50aa807f0 req-608b33cb-f070-4458-9e20-f1cf97d79f2c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060203 Jul 26 17:22:39.203810 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 501/1062] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:22:40.217352 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-eaf6f45e-73ea-40bc-b985-3f1789fd213b tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:40.218824 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-eaf6f45e-73ea-40bc-b985-3f1789fd213b tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:40.227614 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eaf6f45e-73ea-40bc-b985-3f1789fd213b tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:40.228108 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eaf6f45e-73ea-40bc-b985-3f1789fd213b tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:40.229177 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eaf6f45e-73ea-40bc-b985-3f1789fd213b tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:40.229639 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eaf6f45e-73ea-40bc-b985-3f1789fd213b tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:40.394982 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-eaf6f45e-73ea-40bc-b985-3f1789fd213b tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:40.415017 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-eaf6f45e-73ea-40bc-b985-3f1789fd213b tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1315 microversion: 2.1 time: 0.202802 Jul 26 17:22:40.415604 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 562/1063] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:40 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:41.437717 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-381c6670-59e9-41ad-86b4-64bb57819518 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:41.438599 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-381c6670-59e9-41ad-86b4-64bb57819518 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:41.445928 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-381c6670-59e9-41ad-86b4-64bb57819518 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:41.446385 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-381c6670-59e9-41ad-86b4-64bb57819518 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:41.447177 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-381c6670-59e9-41ad-86b4-64bb57819518 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:41.447615 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-381c6670-59e9-41ad-86b4-64bb57819518 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:41.630190 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-381c6670-59e9-41ad-86b4-64bb57819518 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:41.638198 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-381c6670-59e9-41ad-86b4-64bb57819518 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1315 microversion: 2.1 time: 0.205986 Jul 26 17:22:41.641777 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 502/1064] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:41 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:42.663326 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d3fd67af-5c8d-4840-bb69-e98f42a967d2 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:42.664072 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d3fd67af-5c8d-4840-bb69-e98f42a967d2 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:42.671447 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3fd67af-5c8d-4840-bb69-e98f42a967d2 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:42.671897 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3fd67af-5c8d-4840-bb69-e98f42a967d2 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:42.672764 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3fd67af-5c8d-4840-bb69-e98f42a967d2 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:42.673228 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3fd67af-5c8d-4840-bb69-e98f42a967d2 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:42.854884 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d3fd67af-5c8d-4840-bb69-e98f42a967d2 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:42.867778 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d3fd67af-5c8d-4840-bb69-e98f42a967d2 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1315 microversion: 2.1 time: 0.208459 Jul 26 17:22:42.869359 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 563/1065] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:42 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:43.890306 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-13f949b4-f822-4877-a88b-8e335816591e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:43.890920 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-13f949b4-f822-4877-a88b-8e335816591e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:43.899084 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-13f949b4-f822-4877-a88b-8e335816591e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:43.899530 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-13f949b4-f822-4877-a88b-8e335816591e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:43.900314 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-13f949b4-f822-4877-a88b-8e335816591e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:43.900747 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-13f949b4-f822-4877-a88b-8e335816591e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:44.045626 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-13f949b4-f822-4877-a88b-8e335816591e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:44.053335 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-13f949b4-f822-4877-a88b-8e335816591e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1315 microversion: 2.1 time: 0.167069 Jul 26 17:22:44.053949 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 503/1066] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:43 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:44.245468 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-fdb2a29c-e10f-46bb-8b23-1dbb7046338c req-70b8eceb-304e-4498-8255-bc448596d475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25815535-2905-4c19-af09-3b0e450f11e1", "name": "network-vif-plugged", "status": "completed", "tag": "25acfa16-3ffc-4e7d-8e58-354333aac6ea"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:22:44.258578 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-fdb2a29c-e10f-46bb-8b23-1dbb7046338c req-70b8eceb-304e-4498-8255-bc448596d475 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:44.258578 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-fdb2a29c-e10f-46bb-8b23-1dbb7046338c req-70b8eceb-304e-4498-8255-bc448596d475 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:44.270515 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-fdb2a29c-e10f-46bb-8b23-1dbb7046338c req-70b8eceb-304e-4498-8255-bc448596d475 service nova] Creating event network-vif-plugged:25acfa16-3ffc-4e7d-8e58-354333aac6ea for instance 25815535-2905-4c19-af09-3b0e450f11e1 on hv-cinder-83538 Jul 26 17:22:44.276157 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-fdb2a29c-e10f-46bb-8b23-1dbb7046338c req-70b8eceb-304e-4498-8255-bc448596d475 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034799 Jul 26 17:22:44.277137 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 564/1067] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:22:45.075466 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-84042c46-0b28-485d-be9b-d5679c7247ad tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:45.076054 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-84042c46-0b28-485d-be9b-d5679c7247ad tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:45.084008 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84042c46-0b28-485d-be9b-d5679c7247ad tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:45.084531 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84042c46-0b28-485d-be9b-d5679c7247ad tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:45.085322 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84042c46-0b28-485d-be9b-d5679c7247ad tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:45.085875 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84042c46-0b28-485d-be9b-d5679c7247ad tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:45.218409 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-84042c46-0b28-485d-be9b-d5679c7247ad tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:45.226451 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-84042c46-0b28-485d-be9b-d5679c7247ad tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1315 microversion: 2.1 time: 0.154840 Jul 26 17:22:45.227018 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 504/1068] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:45 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:46.250891 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9d987926-9494-4a7c-9200-1c76809efb46 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:46.251776 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9d987926-9494-4a7c-9200-1c76809efb46 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:46.255220 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:46.256092 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=6 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:46.264588 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d987926-9494-4a7c-9200-1c76809efb46 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:46.265251 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d987926-9494-4a7c-9200-1c76809efb46 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:46.266289 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d987926-9494-4a7c-9200-1c76809efb46 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:46.266731 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d987926-9494-4a7c-9200-1c76809efb46 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:46.430370 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9d987926-9494-4a7c-9200-1c76809efb46 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:46.437945 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9d987926-9494-4a7c-9200-1c76809efb46 tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1465 microversion: 2.1 time: 0.192562 Jul 26 17:22:46.438516 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 565/1069] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:46 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1465 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:22:46.484183 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-215ed2ac-0275-499d-a5e8-99878e0408fe tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:46.484777 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-215ed2ac-0275-499d-a5e8-99878e0408fe tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:46.486643 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:46.492823 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-215ed2ac-0275-499d-a5e8-99878e0408fe tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:46.493375 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-215ed2ac-0275-499d-a5e8-99878e0408fe tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:46.494915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-215ed2ac-0275-499d-a5e8-99878e0408fe tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:46.494915 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-215ed2ac-0275-499d-a5e8-99878e0408fe tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:46.520844 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-215ed2ac-0275-499d-a5e8-99878e0408fe tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Going to try to terminate instance {{(pid=118122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:22:46.587156 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-23c272d5-9949-4f8b-a00d-7e781a4b4ff5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:22:46.589540 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-23c272d5-9949-4f8b-a00d-7e781a4b4ff5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:46.595808 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23c272d5-9949-4f8b-a00d-7e781a4b4ff5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:46.596398 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23c272d5-9949-4f8b-a00d-7e781a4b4ff5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:46.597310 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23c272d5-9949-4f8b-a00d-7e781a4b4ff5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:46.597850 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23c272d5-9949-4f8b-a00d-7e781a4b4ff5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:46.601153 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-215ed2ac-0275-499d-a5e8-99878e0408fe tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "DELETE /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 204 len: 0 microversion: 2.1 time: 0.120346 Jul 26 17:22:46.601986 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 505/1070] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:22:46 2022] DELETE /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:22:46.611423 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8c9a92c1-63ce-452a-b1b7-9e52e408c7db tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:46.612126 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-8c9a92c1-63ce-452a-b1b7-9e52e408c7db tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:46.619635 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8c9a92c1-63ce-452a-b1b7-9e52e408c7db tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:46.620089 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8c9a92c1-63ce-452a-b1b7-9e52e408c7db tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:46.620879 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8c9a92c1-63ce-452a-b1b7-9e52e408c7db tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:46.621341 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-8c9a92c1-63ce-452a-b1b7-9e52e408c7db tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:46.682784 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-23c272d5-9949-4f8b-a00d-7e781a4b4ff5 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "POST /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/action" status: 202 len: 0 microversion: 2.1 time: 0.099537 Jul 26 17:22:46.683652 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 566/1071] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:22:46 2022] POST /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 17:22:46.693494 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9a14a442-9957-40cf-926f-6e7ac0f3ef4b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:46.694612 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9a14a442-9957-40cf-926f-6e7ac0f3ef4b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:46.702212 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a14a442-9957-40cf-926f-6e7ac0f3ef4b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:46.702795 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a14a442-9957-40cf-926f-6e7ac0f3ef4b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:46.703728 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a14a442-9957-40cf-926f-6e7ac0f3ef4b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:46.704171 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a14a442-9957-40cf-926f-6e7ac0f3ef4b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:46.786703 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-8c9a92c1-63ce-452a-b1b7-9e52e408c7db tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:46.803278 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8c9a92c1-63ce-452a-b1b7-9e52e408c7db tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1471 microversion: 2.1 time: 0.196068 Jul 26 17:22:46.806389 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 506/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:46 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:46.883064 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a14a442-9957-40cf-926f-6e7ac0f3ef4b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:46.891141 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9a14a442-9957-40cf-926f-6e7ac0f3ef4b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1752 microversion: 2.1 time: 0.202993 Jul 26 17:22:46.891708 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 567/1073] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:46 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1752 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:22:47.832820 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-7e0fc1a0-8b43-40ea-8554-2bac7bf6dd3e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:47.833463 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-7e0fc1a0-8b43-40ea-8554-2bac7bf6dd3e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:47.839846 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7e0fc1a0-8b43-40ea-8554-2bac7bf6dd3e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:47.840319 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7e0fc1a0-8b43-40ea-8554-2bac7bf6dd3e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:47.841108 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7e0fc1a0-8b43-40ea-8554-2bac7bf6dd3e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:47.841535 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-7e0fc1a0-8b43-40ea-8554-2bac7bf6dd3e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:47.912640 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-87f688da-3366-4d2c-8315-85209db2d7d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:47.913287 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-87f688da-3366-4d2c-8315-85209db2d7d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:47.921506 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87f688da-3366-4d2c-8315-85209db2d7d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:47.921952 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87f688da-3366-4d2c-8315-85209db2d7d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:47.922719 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87f688da-3366-4d2c-8315-85209db2d7d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:47.923148 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87f688da-3366-4d2c-8315-85209db2d7d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:47.982681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-7e0fc1a0-8b43-40ea-8554-2bac7bf6dd3e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:47.991272 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-7e0fc1a0-8b43-40ea-8554-2bac7bf6dd3e tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1471 microversion: 2.1 time: 0.162438 Jul 26 17:22:47.991847 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 507/1074] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:47 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:48.072066 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-87f688da-3366-4d2c-8315-85209db2d7d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:48.080461 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-87f688da-3366-4d2c-8315-85209db2d7d7 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1752 microversion: 2.1 time: 0.172464 Jul 26 17:22:48.081355 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 568/1075] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:47 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:22:49.012890 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-fde8d4ae-1921-4fcb-883d-b981f89ff93a tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:49.013355 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-fde8d4ae-1921-4fcb-883d-b981f89ff93a tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:49.019973 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fde8d4ae-1921-4fcb-883d-b981f89ff93a tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:49.020195 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fde8d4ae-1921-4fcb-883d-b981f89ff93a tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:49.020929 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fde8d4ae-1921-4fcb-883d-b981f89ff93a tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:49.021385 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fde8d4ae-1921-4fcb-883d-b981f89ff93a tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:49.103390 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a77be702-1a49-4c6a-b951-6f8b54571561 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:49.104006 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a77be702-1a49-4c6a-b951-6f8b54571561 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:49.110827 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a77be702-1a49-4c6a-b951-6f8b54571561 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:49.111286 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a77be702-1a49-4c6a-b951-6f8b54571561 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:49.112110 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a77be702-1a49-4c6a-b951-6f8b54571561 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:49.112543 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a77be702-1a49-4c6a-b951-6f8b54571561 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:49.170246 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-fde8d4ae-1921-4fcb-883d-b981f89ff93a tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56196da2cd48dfb831994871e127be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a1957117fc4a8497f01474d163fae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:49.178771 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-fde8d4ae-1921-4fcb-883d-b981f89ff93a tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 200 len: 1471 microversion: 2.1 time: 0.170029 Jul 26 17:22:49.179362 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 508/1076] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:49 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:49.376140 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a77be702-1a49-4c6a-b951-6f8b54571561 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:49.394095 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a77be702-1a49-4c6a-b951-6f8b54571561 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1752 microversion: 2.1 time: 0.294488 Jul 26 17:22:49.395732 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 569/1077] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:49 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1752 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:49.443922 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-07745b48-d99e-410b-8099-18b936ccc175 req-8a542eae-4df3-4853-9e32-737de91f89a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25815535-2905-4c19-af09-3b0e450f11e1", "name": "network-vif-deleted", "tag": "25acfa16-3ffc-4e7d-8e58-354333aac6ea"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:22:49.457506 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-07745b48-d99e-410b-8099-18b936ccc175 req-8a542eae-4df3-4853-9e32-737de91f89a9 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:49.457962 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-07745b48-d99e-410b-8099-18b936ccc175 req-8a542eae-4df3-4853-9e32-737de91f89a9 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:49.469833 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-07745b48-d99e-410b-8099-18b936ccc175 req-8a542eae-4df3-4853-9e32-737de91f89a9 service nova] Creating event network-vif-deleted:25acfa16-3ffc-4e7d-8e58-354333aac6ea for instance 25815535-2905-4c19-af09-3b0e450f11e1 on hv-cinder-83538 Jul 26 17:22:49.475619 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-07745b48-d99e-410b-8099-18b936ccc175 req-8a542eae-4df3-4853-9e32-737de91f89a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036259 Jul 26 17:22:49.476318 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 509/1078] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:22:50.201600 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9ad1920c-5ee4-4e86-8ecf-02090bc531fc tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:50.202367 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9ad1920c-5ee4-4e86-8ecf-02090bc531fc tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] [instance: 25815535-2905-4c19-af09-3b0e450f11e1] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:50.210203 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ad1920c-5ee4-4e86-8ecf-02090bc531fc tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:50.210687 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ad1920c-5ee4-4e86-8ecf-02090bc531fc tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:50.211522 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ad1920c-5ee4-4e86-8ecf-02090bc531fc tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:50.211976 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ad1920c-5ee4-4e86-8ecf-02090bc531fc tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:50.226063 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-9ad1920c-5ee4-4e86-8ecf-02090bc531fc tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] HTTP exception thrown: Instance 25815535-2905-4c19-af09-3b0e450f11e1 could not be found. Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9ad1920c-5ee4-4e86-8ecf-02090bc531fc tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Request method failure captured: Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 HTTP/1.1 Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CLY7dvMoGCWdetnzm-UEn7iWjuN_hg9-B2rUb83vjgds2SBPzasRkapdCajfZ022brJAFRXOTZeY4junEBRndx1hL4nPWPj_VGDD7socgGol0fgT0Zd5u6UlwO1DF4shy9FT0xahDFsHtp9PHV2KN2Ftlo1nJn1nSxm-JAb3rgahwE Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: 00a1957117fc4a8497f01474d163fae0 Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesNegativeTest-441748826 Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:22:50.227715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:22:50.229314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/00a1957117fc4a8497f01474d163fae0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_00a1957117fc4a8497f01474d163fae0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/00a1957117fc4a8497f01474d163fae0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/00a1957117fc4a8497f01474d163fae0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:22:50.229314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesNegativeTest-441748826 Jul 26 17:22:50.229314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 00a1957117fc4a8497f01474d163fae0 Jul 26 17:22:50.229314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesNegativeTest-441748826 Jul 26 17:22:50.229314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesNegativeTest-441748826-project Jul 26 17:22:50.229314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:22:50.229314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:22:50.229314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: 7f56196da2cd48dfb831994871e127be Jul 26 17:22:50.229314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesNegativeTest-441748826-project Jul 26 17:22:50.229314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:22:50.229314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance 25815535-2905-4c19-af09-3b0e450f11e1 could not be found. Jul 26 17:22:50.229314 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '25815535-2905-4c19-af09-3b0e450f11e1'} Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25815535-2905-4c19-af09-3b0e450f11e1 could not be found. Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:22:50.230170 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25815535-2905-4c19-af09-3b0e450f11e1 could not be found. Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25815535-2905-4c19-af09-3b0e450f11e1 could not be found. Jul 26 17:22:50.231430 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:22:50.232553 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9ad1920c-5ee4-4e86-8ecf-02090bc531fc tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] Returning 404 to user: Instance 25815535-2905-4c19-af09-3b0e450f11e1 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:22:50.232553 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9ad1920c-5ee4-4e86-8ecf-02090bc531fc tempest-VolumesNegativeTest-441748826 tempest-VolumesNegativeTest-441748826-project] 10.222.0.48 "GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1" status: 404 len: 111 microversion: 2.1 time: 0.032104 Jul 26 17:22:50.232553 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 570/1079] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:50 2022] GET /compute/v2.1/servers/25815535-2905-4c19-af09-3b0e450f11e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:22:50.419676 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-126326e9-de03-44d7-950b-75be5e625947 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:50.420485 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-126326e9-de03-44d7-950b-75be5e625947 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:50.428035 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-126326e9-de03-44d7-950b-75be5e625947 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:50.428525 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-126326e9-de03-44d7-950b-75be5e625947 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:50.429384 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-126326e9-de03-44d7-950b-75be5e625947 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:50.429820 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-126326e9-de03-44d7-950b-75be5e625947 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:50.583475 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-126326e9-de03-44d7-950b-75be5e625947 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:50.591947 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-126326e9-de03-44d7-950b-75be5e625947 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.177533 Jul 26 17:22:50.592528 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 510/1080] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:50 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:51.617919 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-abe8cc62-8344-4691-87ab-468535433cbb tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:51.618767 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-abe8cc62-8344-4691-87ab-468535433cbb tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:51.626263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abe8cc62-8344-4691-87ab-468535433cbb tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:51.626714 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abe8cc62-8344-4691-87ab-468535433cbb tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:51.629124 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abe8cc62-8344-4691-87ab-468535433cbb tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:51.629599 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abe8cc62-8344-4691-87ab-468535433cbb tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:51.787939 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-abe8cc62-8344-4691-87ab-468535433cbb tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:51.796016 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-abe8cc62-8344-4691-87ab-468535433cbb tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.184552 Jul 26 17:22:51.796573 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 571/1081] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:51 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:52.820011 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1f5eeae2-0cd3-4970-86fd-b315ce110c03 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:52.820780 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1f5eeae2-0cd3-4970-86fd-b315ce110c03 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:52.823153 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:52.828722 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1f5eeae2-0cd3-4970-86fd-b315ce110c03 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:52.829233 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1f5eeae2-0cd3-4970-86fd-b315ce110c03 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:52.830012 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1f5eeae2-0cd3-4970-86fd-b315ce110c03 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:52.830447 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1f5eeae2-0cd3-4970-86fd-b315ce110c03 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:52.833787 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:22:52.989991 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1f5eeae2-0cd3-4970-86fd-b315ce110c03 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:52.998473 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1f5eeae2-0cd3-4970-86fd-b315ce110c03 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.182621 Jul 26 17:22:52.999043 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 511/1082] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:52 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:54.021653 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0fd116b8-4b01-42a0-9d93-6c810d0e5bf0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:54.022271 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0fd116b8-4b01-42a0-9d93-6c810d0e5bf0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:54.028894 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fd116b8-4b01-42a0-9d93-6c810d0e5bf0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:54.029382 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fd116b8-4b01-42a0-9d93-6c810d0e5bf0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:54.030179 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fd116b8-4b01-42a0-9d93-6c810d0e5bf0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:54.030624 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fd116b8-4b01-42a0-9d93-6c810d0e5bf0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:54.180248 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0fd116b8-4b01-42a0-9d93-6c810d0e5bf0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:54.188468 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0fd116b8-4b01-42a0-9d93-6c810d0e5bf0 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.171419 Jul 26 17:22:54.189074 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 572/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:54 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:55.209994 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2b5c5503-e734-478d-97ec-f6fb7965a24e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:55.210700 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2b5c5503-e734-478d-97ec-f6fb7965a24e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:55.217322 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2b5c5503-e734-478d-97ec-f6fb7965a24e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:55.217780 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2b5c5503-e734-478d-97ec-f6fb7965a24e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:55.218557 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2b5c5503-e734-478d-97ec-f6fb7965a24e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:55.219041 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2b5c5503-e734-478d-97ec-f6fb7965a24e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:55.368795 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-2b5c5503-e734-478d-97ec-f6fb7965a24e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:55.377004 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2b5c5503-e734-478d-97ec-f6fb7965a24e tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.170801 Jul 26 17:22:55.377564 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 512/1084] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:55 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:56.398624 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7eac1a19-1ce8-48fb-8f15-395688370567 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:56.399230 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7eac1a19-1ce8-48fb-8f15-395688370567 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:56.406174 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7eac1a19-1ce8-48fb-8f15-395688370567 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:56.406619 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7eac1a19-1ce8-48fb-8f15-395688370567 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:56.407383 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7eac1a19-1ce8-48fb-8f15-395688370567 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:56.407813 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7eac1a19-1ce8-48fb-8f15-395688370567 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:56.551133 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7eac1a19-1ce8-48fb-8f15-395688370567 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:56.559238 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7eac1a19-1ce8-48fb-8f15-395688370567 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.164469 Jul 26 17:22:56.559804 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 573/1085] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:56 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:57.580918 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-56072bd7-69ec-4ff7-a5ca-b4fcf1ccc0b1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:57.581553 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-56072bd7-69ec-4ff7-a5ca-b4fcf1ccc0b1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:57.588062 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-56072bd7-69ec-4ff7-a5ca-b4fcf1ccc0b1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:57.588507 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-56072bd7-69ec-4ff7-a5ca-b4fcf1ccc0b1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:57.589608 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-56072bd7-69ec-4ff7-a5ca-b4fcf1ccc0b1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:57.589733 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-56072bd7-69ec-4ff7-a5ca-b4fcf1ccc0b1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:57.730571 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-56072bd7-69ec-4ff7-a5ca-b4fcf1ccc0b1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:57.738524 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-56072bd7-69ec-4ff7-a5ca-b4fcf1ccc0b1 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.160960 Jul 26 17:22:57.739083 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 513/1086] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:57 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:22:58.760168 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3ff9e7d0-e8c7-4ace-a95b-49592e239c51 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:22:58.760768 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3ff9e7d0-e8c7-4ace-a95b-49592e239c51 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:22:58.767196 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ff9e7d0-e8c7-4ace-a95b-49592e239c51 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:58.767637 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ff9e7d0-e8c7-4ace-a95b-49592e239c51 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:58.768440 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ff9e7d0-e8c7-4ace-a95b-49592e239c51 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:22:58.769448 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ff9e7d0-e8c7-4ace-a95b-49592e239c51 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:22:59.084526 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3ff9e7d0-e8c7-4ace-a95b-49592e239c51 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:22:59.092401 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3ff9e7d0-e8c7-4ace-a95b-49592e239c51 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.336292 Jul 26 17:22:59.092982 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 574/1087] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:22:58 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:00.114400 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-1edba23e-5b24-4df3-b416-e7df4b4cc02d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:00.115023 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-1edba23e-5b24-4df3-b416-e7df4b4cc02d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:00.121635 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1edba23e-5b24-4df3-b416-e7df4b4cc02d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:00.122343 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1edba23e-5b24-4df3-b416-e7df4b4cc02d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:00.123111 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1edba23e-5b24-4df3-b416-e7df4b4cc02d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:00.123538 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-1edba23e-5b24-4df3-b416-e7df4b4cc02d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:00.283889 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-1edba23e-5b24-4df3-b416-e7df4b4cc02d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:00.292146 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-1edba23e-5b24-4df3-b416-e7df4b4cc02d tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.182165 Jul 26 17:23:00.292711 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 514/1088] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:00 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:01.314705 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8e445e74-e5c8-4f28-95f2-7aaf7816459f tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:01.315284 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8e445e74-e5c8-4f28-95f2-7aaf7816459f tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:01.321570 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e445e74-e5c8-4f28-95f2-7aaf7816459f tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:01.322019 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e445e74-e5c8-4f28-95f2-7aaf7816459f tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:01.322781 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e445e74-e5c8-4f28-95f2-7aaf7816459f tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:01.323214 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e445e74-e5c8-4f28-95f2-7aaf7816459f tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:01.470777 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8e445e74-e5c8-4f28-95f2-7aaf7816459f tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:01.479801 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8e445e74-e5c8-4f28-95f2-7aaf7816459f tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.169050 Jul 26 17:23:01.480363 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 575/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:01 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:02.502072 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9d64336d-0bb1-4df7-b2fe-68ee5b898d61 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:02.502686 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9d64336d-0bb1-4df7-b2fe-68ee5b898d61 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:02.510085 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9d64336d-0bb1-4df7-b2fe-68ee5b898d61 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:02.510536 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9d64336d-0bb1-4df7-b2fe-68ee5b898d61 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:02.511303 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9d64336d-0bb1-4df7-b2fe-68ee5b898d61 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:02.511739 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9d64336d-0bb1-4df7-b2fe-68ee5b898d61 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:02.713510 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-9d64336d-0bb1-4df7-b2fe-68ee5b898d61 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:02.722175 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9d64336d-0bb1-4df7-b2fe-68ee5b898d61 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.223756 Jul 26 17:23:02.722877 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 515/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:02 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:03.743883 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c7a5d641-34d0-42bb-ac6e-a7970cb5abf4 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:03.744426 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c7a5d641-34d0-42bb-ac6e-a7970cb5abf4 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:03.751256 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7a5d641-34d0-42bb-ac6e-a7970cb5abf4 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:03.751712 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7a5d641-34d0-42bb-ac6e-a7970cb5abf4 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:03.752484 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7a5d641-34d0-42bb-ac6e-a7970cb5abf4 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:03.752991 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7a5d641-34d0-42bb-ac6e-a7970cb5abf4 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:03.901286 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c7a5d641-34d0-42bb-ac6e-a7970cb5abf4 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:03.910796 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c7a5d641-34d0-42bb-ac6e-a7970cb5abf4 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.170879 Jul 26 17:23:03.911361 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 576/1091] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:03 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:04.932334 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c1ffa349-ea8a-4f5c-ad79-e5cf4fba20a2 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:04.933004 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c1ffa349-ea8a-4f5c-ad79-e5cf4fba20a2 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:04.939544 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1ffa349-ea8a-4f5c-ad79-e5cf4fba20a2 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:04.939990 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1ffa349-ea8a-4f5c-ad79-e5cf4fba20a2 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:04.941404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1ffa349-ea8a-4f5c-ad79-e5cf4fba20a2 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:04.941949 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c1ffa349-ea8a-4f5c-ad79-e5cf4fba20a2 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:05.102269 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c1ffa349-ea8a-4f5c-ad79-e5cf4fba20a2 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:05.110336 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c1ffa349-ea8a-4f5c-ad79-e5cf4fba20a2 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.181937 Jul 26 17:23:05.110918 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 516/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:04 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:06.134356 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0917b984-1d4d-45fb-8b33-e3326e47a9e6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:06.134981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0917b984-1d4d-45fb-8b33-e3326e47a9e6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:06.142330 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0917b984-1d4d-45fb-8b33-e3326e47a9e6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:06.142779 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0917b984-1d4d-45fb-8b33-e3326e47a9e6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:06.143584 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0917b984-1d4d-45fb-8b33-e3326e47a9e6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:06.144024 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0917b984-1d4d-45fb-8b33-e3326e47a9e6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:06.146944 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:23:06.291505 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0917b984-1d4d-45fb-8b33-e3326e47a9e6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:06.299569 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0917b984-1d4d-45fb-8b33-e3326e47a9e6 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1757 microversion: 2.1 time: 0.170173 Jul 26 17:23:06.300703 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 577/1093] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:06 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:07.321829 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ffcd9b49-4596-4118-b141-a87ac666974b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:07.322429 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ffcd9b49-4596-4118-b141-a87ac666974b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:07.328922 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ffcd9b49-4596-4118-b141-a87ac666974b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:07.329395 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ffcd9b49-4596-4118-b141-a87ac666974b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:07.330148 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ffcd9b49-4596-4118-b141-a87ac666974b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:07.330579 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ffcd9b49-4596-4118-b141-a87ac666974b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:07.479730 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ffcd9b49-4596-4118-b141-a87ac666974b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:07.488306 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ffcd9b49-4596-4118-b141-a87ac666974b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1760 microversion: 2.1 time: 0.170324 Jul 26 17:23:07.489168 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 517/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:07 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1760 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:12.984877 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1063700919", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1393964861", "security_groups": [{"name": "tempest-secgroup-smoke-1628658040"}], "block_device_mapping_v2": [{"uuid": "8dff8913-748c-4d82-8692-4453c3d57975", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dc0fe413-bc4b-4401-bb71-d74110a1081f"}]}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:23:12.995857 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=36 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:23:13.122217 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] validate_networks() for [('dc0fe413-bc4b-4401-bb71-d74110a1081f', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 17:23:13.244555 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 17:23:13.245089 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Tue Jul 26 17:23:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 17:23:13.543563 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 17:23:13.543980 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 17:23:13.544446 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 17:23:13.544933 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 17:23:13.545365 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 17:23:13.555747 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:13.556190 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:13.557006 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:13.557443 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:13.576115 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Getting quotas for project b888b1053bb043dbb88d674c9a504a86. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 17:23:13.585187 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Getting quotas for user dcf968aeb53c4215927642e9931b4a5e and project b888b1053bb043dbb88d674c9a504a86. Resources: {'instances', 'ram', 'cores'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 17:23:13.667261 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 17:23:13.669470 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8dff8913-748c-4d82-8692-4453c3d57975',volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 17:23:13.838384 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2170e8b0-033c-4fe3-9875-3868ca84d4ca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.856832 Jul 26 17:23:13.839787 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 578/1095] 10.222.0.48 () {60 vars in 1147 bytes} [Tue Jul 26 17:23:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 17:23:13.851431 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6e3bd41f-1eaa-4061-bd46-6ac8287aeafa tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:13.852041 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6e3bd41f-1eaa-4061-bd46-6ac8287aeafa tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:13.914398 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6e3bd41f-1eaa-4061-bd46-6ac8287aeafa tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:13.921554 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6e3bd41f-1eaa-4061-bd46-6ac8287aeafa tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1095 microversion: 2.1 time: 0.074628 Jul 26 17:23:13.922059 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 518/1096] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:13 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:23:14.958729 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0c42a002-e899-439a-b912-3f5f5dbb94c1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:14.959526 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0c42a002-e899-439a-b912-3f5f5dbb94c1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:14.982479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c42a002-e899-439a-b912-3f5f5dbb94c1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:14.983291 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c42a002-e899-439a-b912-3f5f5dbb94c1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:14.984665 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c42a002-e899-439a-b912-3f5f5dbb94c1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:14.985479 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c42a002-e899-439a-b912-3f5f5dbb94c1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:15.085982 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c42a002-e899-439a-b912-3f5f5dbb94c1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:15.093848 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0c42a002-e899-439a-b912-3f5f5dbb94c1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1211 microversion: 2.1 time: 0.140032 Jul 26 17:23:15.094614 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 579/1097] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:14 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1211 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:16.116543 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6c40c74c-6929-444f-93f7-139548143c7f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:16.117359 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6c40c74c-6929-444f-93f7-139548143c7f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:16.126370 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6c40c74c-6929-444f-93f7-139548143c7f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:16.127816 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6c40c74c-6929-444f-93f7-139548143c7f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:16.129127 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6c40c74c-6929-444f-93f7-139548143c7f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:16.129735 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6c40c74c-6929-444f-93f7-139548143c7f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:16.316666 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6c40c74c-6929-444f-93f7-139548143c7f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:16.326745 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6c40c74c-6929-444f-93f7-139548143c7f tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1267 microversion: 2.1 time: 0.214320 Jul 26 17:23:16.327458 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 519/1098] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:16 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:16.459054 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-acd15109-9d16-4c4b-8753-0fe2a585b4c8 req-978166a3-e92b-4b23-a244-b04867fcb8ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22505cde-212d-4415-a77d-4d8e5d1a37d3", "tag": "4788e653-d0af-42d0-876b-aa680735e98c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:23:16.489821 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-acd15109-9d16-4c4b-8753-0fe2a585b4c8 req-978166a3-e92b-4b23-a244-b04867fcb8ab service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:16.490757 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-acd15109-9d16-4c4b-8753-0fe2a585b4c8 req-978166a3-e92b-4b23-a244-b04867fcb8ab service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:16.517857 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-acd15109-9d16-4c4b-8753-0fe2a585b4c8 req-978166a3-e92b-4b23-a244-b04867fcb8ab service nova] Creating event network-changed:4788e653-d0af-42d0-876b-aa680735e98c for instance 22505cde-212d-4415-a77d-4d8e5d1a37d3 on hv-cinder-83538 Jul 26 17:23:16.525746 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-acd15109-9d16-4c4b-8753-0fe2a585b4c8 req-978166a3-e92b-4b23-a244-b04867fcb8ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076894 Jul 26 17:23:16.526386 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 580/1099] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:23:17.361987 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-84eb6028-1ae0-4421-b408-b9bc7818906d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:17.363100 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-84eb6028-1ae0-4421-b408-b9bc7818906d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:17.369410 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84eb6028-1ae0-4421-b408-b9bc7818906d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:17.369901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84eb6028-1ae0-4421-b408-b9bc7818906d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:17.370684 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84eb6028-1ae0-4421-b408-b9bc7818906d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:17.371121 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-84eb6028-1ae0-4421-b408-b9bc7818906d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:17.508404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-84eb6028-1ae0-4421-b408-b9bc7818906d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:17.515899 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-84eb6028-1ae0-4421-b408-b9bc7818906d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1267 microversion: 2.1 time: 0.157790 Jul 26 17:23:17.516466 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 520/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:17 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:18.539325 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-38fad977-0b3c-48b1-a13d-900e39c7d833 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:18.539932 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-38fad977-0b3c-48b1-a13d-900e39c7d833 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:18.546723 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38fad977-0b3c-48b1-a13d-900e39c7d833 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:18.547206 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38fad977-0b3c-48b1-a13d-900e39c7d833 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:18.548020 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38fad977-0b3c-48b1-a13d-900e39c7d833 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:18.548459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38fad977-0b3c-48b1-a13d-900e39c7d833 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:18.717473 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-38fad977-0b3c-48b1-a13d-900e39c7d833 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:18.727110 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-38fad977-0b3c-48b1-a13d-900e39c7d833 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1267 microversion: 2.1 time: 0.192938 Jul 26 17:23:18.727715 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 581/1101] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:18 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:23:19.749514 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-69f99bad-363c-4d17-9ef9-aae2d91f21b1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:19.750074 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-69f99bad-363c-4d17-9ef9-aae2d91f21b1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:19.756901 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-69f99bad-363c-4d17-9ef9-aae2d91f21b1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:19.757513 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-69f99bad-363c-4d17-9ef9-aae2d91f21b1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:19.758414 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-69f99bad-363c-4d17-9ef9-aae2d91f21b1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:19.758933 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-69f99bad-363c-4d17-9ef9-aae2d91f21b1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:19.899706 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-69f99bad-363c-4d17-9ef9-aae2d91f21b1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:19.907278 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-69f99bad-363c-4d17-9ef9-aae2d91f21b1 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1267 microversion: 2.1 time: 0.162010 Jul 26 17:23:19.907857 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 521/1102] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:19 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:20.929299 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-613a7f61-72c5-4495-9fc0-c72ede3a4973 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:20.929951 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-613a7f61-72c5-4495-9fc0-c72ede3a4973 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:20.936600 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-613a7f61-72c5-4495-9fc0-c72ede3a4973 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:20.937089 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-613a7f61-72c5-4495-9fc0-c72ede3a4973 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:20.937878 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-613a7f61-72c5-4495-9fc0-c72ede3a4973 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:20.938319 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-613a7f61-72c5-4495-9fc0-c72ede3a4973 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:21.079621 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-613a7f61-72c5-4495-9fc0-c72ede3a4973 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:21.088102 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-613a7f61-72c5-4495-9fc0-c72ede3a4973 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1267 microversion: 2.1 time: 0.162704 Jul 26 17:23:21.088673 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 582/1103] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:20 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:23:22.109903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-53d10ee8-3a2c-4aeb-90b1-4cf24c31d274 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:22.110519 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-53d10ee8-3a2c-4aeb-90b1-4cf24c31d274 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:22.117669 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-53d10ee8-3a2c-4aeb-90b1-4cf24c31d274 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:22.118114 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-53d10ee8-3a2c-4aeb-90b1-4cf24c31d274 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:22.118903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-53d10ee8-3a2c-4aeb-90b1-4cf24c31d274 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:22.119337 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-53d10ee8-3a2c-4aeb-90b1-4cf24c31d274 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:22.261172 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-53d10ee8-3a2c-4aeb-90b1-4cf24c31d274 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:22.269639 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-53d10ee8-3a2c-4aeb-90b1-4cf24c31d274 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1267 microversion: 2.1 time: 0.163676 Jul 26 17:23:22.270296 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 522/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:22 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:23.292115 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ec94dce-ab13-46d4-a1c7-abd0d7ec50c5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:23.292738 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ec94dce-ab13-46d4-a1c7-abd0d7ec50c5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:23.300361 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ec94dce-ab13-46d4-a1c7-abd0d7ec50c5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:23.300938 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ec94dce-ab13-46d4-a1c7-abd0d7ec50c5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:23.301756 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ec94dce-ab13-46d4-a1c7-abd0d7ec50c5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:23.302194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ec94dce-ab13-46d4-a1c7-abd0d7ec50c5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:23.442797 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ec94dce-ab13-46d4-a1c7-abd0d7ec50c5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:23.450415 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ec94dce-ab13-46d4-a1c7-abd0d7ec50c5 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1267 microversion: 2.1 time: 0.162362 Jul 26 17:23:23.450972 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 583/1105] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:23 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:24.473704 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-f954f390-08ef-4710-a175-2715cb714dca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:24.474340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-f954f390-08ef-4710-a175-2715cb714dca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:24.476734 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell0:SELECT=2 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:23:24.477412 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=26 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:23:24.483683 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f954f390-08ef-4710-a175-2715cb714dca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:24.484132 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f954f390-08ef-4710-a175-2715cb714dca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:24.484914 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f954f390-08ef-4710-a175-2715cb714dca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:24.485539 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-f954f390-08ef-4710-a175-2715cb714dca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:24.490017 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=66 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:23:24.633181 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-f954f390-08ef-4710-a175-2715cb714dca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:24.641532 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-f954f390-08ef-4710-a175-2715cb714dca tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1267 microversion: 2.1 time: 0.173037 Jul 26 17:23:24.642119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 523/1106] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:24 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:23:25.662920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3c3c4165-69cb-4c80-a6f3-6f5325de3a3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:25.663692 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3c3c4165-69cb-4c80-a6f3-6f5325de3a3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:25.665614 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:23:25.666328 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=6 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:23:25.672485 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c3c4165-69cb-4c80-a6f3-6f5325de3a3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:25.672939 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c3c4165-69cb-4c80-a6f3-6f5325de3a3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:25.673754 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c3c4165-69cb-4c80-a6f3-6f5325de3a3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:25.674710 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c3c4165-69cb-4c80-a6f3-6f5325de3a3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:25.828676 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3c3c4165-69cb-4c80-a6f3-6f5325de3a3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:25.836949 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3c3c4165-69cb-4c80-a6f3-6f5325de3a3d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1267 microversion: 2.1 time: 0.178221 Jul 26 17:23:25.837697 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 584/1107] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:25 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:26.858979 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c8b6f0e4-f5f2-4198-83e7-ca07ad4953ac tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:26.859801 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c8b6f0e4-f5f2-4198-83e7-ca07ad4953ac tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:26.866830 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c8b6f0e4-f5f2-4198-83e7-ca07ad4953ac tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:26.867271 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c8b6f0e4-f5f2-4198-83e7-ca07ad4953ac tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:26.868067 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c8b6f0e4-f5f2-4198-83e7-ca07ad4953ac tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:26.868506 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c8b6f0e4-f5f2-4198-83e7-ca07ad4953ac tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:27.023202 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-c8b6f0e4-f5f2-4198-83e7-ca07ad4953ac tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:27.037053 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c8b6f0e4-f5f2-4198-83e7-ca07ad4953ac tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1267 microversion: 2.1 time: 0.181581 Jul 26 17:23:27.038121 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 524/1108] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:26 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:27.056557 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 17:23:27.057429 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Tue Jul 26 17:23:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 17:23:28.058789 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b24436de-945f-41f0-84f9-47211f6b81cc tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:28.059500 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b24436de-945f-41f0-84f9-47211f6b81cc tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:28.066399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b24436de-945f-41f0-84f9-47211f6b81cc tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:28.066851 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b24436de-945f-41f0-84f9-47211f6b81cc tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:28.067634 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b24436de-945f-41f0-84f9-47211f6b81cc tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:28.068083 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b24436de-945f-41f0-84f9-47211f6b81cc tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:28.218917 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b24436de-945f-41f0-84f9-47211f6b81cc tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:28.227318 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b24436de-945f-41f0-84f9-47211f6b81cc tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1267 microversion: 2.1 time: 0.172388 Jul 26 17:23:28.227906 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 585/1109] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:28 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:28.530111 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-565ed968-247c-4393-b75d-1092d8022a88 req-8927ad75-e5b0-48fa-8578-625484c6530b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22505cde-212d-4415-a77d-4d8e5d1a37d3", "name": "network-vif-plugged", "status": "completed", "tag": "4788e653-d0af-42d0-876b-aa680735e98c"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:23:28.544277 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-565ed968-247c-4393-b75d-1092d8022a88 req-8927ad75-e5b0-48fa-8578-625484c6530b service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:28.544752 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-565ed968-247c-4393-b75d-1092d8022a88 req-8927ad75-e5b0-48fa-8578-625484c6530b service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:28.559043 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-565ed968-247c-4393-b75d-1092d8022a88 req-8927ad75-e5b0-48fa-8578-625484c6530b service nova] Creating event network-vif-plugged:4788e653-d0af-42d0-876b-aa680735e98c for instance 22505cde-212d-4415-a77d-4d8e5d1a37d3 on hv-cinder-83538 Jul 26 17:23:28.565640 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-565ed968-247c-4393-b75d-1092d8022a88 req-8927ad75-e5b0-48fa-8578-625484c6530b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040250 Jul 26 17:23:28.566598 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 525/1110] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:23:29.248806 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8dd4f08a-9390-4d9d-8d7b-8351c70a36cf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:29.249442 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8dd4f08a-9390-4d9d-8d7b-8351c70a36cf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:29.256746 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8dd4f08a-9390-4d9d-8d7b-8351c70a36cf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:29.257369 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8dd4f08a-9390-4d9d-8d7b-8351c70a36cf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:29.258032 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8dd4f08a-9390-4d9d-8d7b-8351c70a36cf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:29.258463 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8dd4f08a-9390-4d9d-8d7b-8351c70a36cf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:29.407778 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8dd4f08a-9390-4d9d-8d7b-8351c70a36cf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:29.415830 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8dd4f08a-9390-4d9d-8d7b-8351c70a36cf tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1267 microversion: 2.1 time: 0.171153 Jul 26 17:23:29.416422 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 586/1111] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:29 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:30.443699 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-edcc1fe1-5220-4f0d-8318-b5ecec7d948d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:30.444407 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-edcc1fe1-5220-4f0d-8318-b5ecec7d948d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:30.451128 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-edcc1fe1-5220-4f0d-8318-b5ecec7d948d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:30.451583 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-edcc1fe1-5220-4f0d-8318-b5ecec7d948d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:30.452365 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-edcc1fe1-5220-4f0d-8318-b5ecec7d948d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:30.452799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-edcc1fe1-5220-4f0d-8318-b5ecec7d948d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:30.627118 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-edcc1fe1-5220-4f0d-8318-b5ecec7d948d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:30.635746 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-edcc1fe1-5220-4f0d-8318-b5ecec7d948d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1453 microversion: 2.1 time: 0.197227 Jul 26 17:23:30.636342 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 526/1112] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:30 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:30.657155 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-49ce49e8-c9ca-4d50-9e21-543c5ed0e803 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:30.657739 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-49ce49e8-c9ca-4d50-9e21-543c5ed0e803 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:30.664893 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49ce49e8-c9ca-4d50-9e21-543c5ed0e803 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:30.665393 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49ce49e8-c9ca-4d50-9e21-543c5ed0e803 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:30.666194 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49ce49e8-c9ca-4d50-9e21-543c5ed0e803 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:30.666629 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49ce49e8-c9ca-4d50-9e21-543c5ed0e803 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:30.823376 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-49ce49e8-c9ca-4d50-9e21-543c5ed0e803 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:30.832263 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-49ce49e8-c9ca-4d50-9e21-543c5ed0e803 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1453 microversion: 2.1 time: 0.179244 Jul 26 17:23:30.832852 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 587/1113] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:30 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:33.120878 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-ed90d25a-b46e-4ff8-bbe4-15e5c01b47f0 req-635e3bf4-92a4-465a-95e7-b4b54e1b92e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22505cde-212d-4415-a77d-4d8e5d1a37d3", "tag": "4788e653-d0af-42d0-876b-aa680735e98c"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:23:33.133465 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-ed90d25a-b46e-4ff8-bbe4-15e5c01b47f0 req-635e3bf4-92a4-465a-95e7-b4b54e1b92e9 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:33.134076 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-ed90d25a-b46e-4ff8-bbe4-15e5c01b47f0 req-635e3bf4-92a4-465a-95e7-b4b54e1b92e9 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:33.147643 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-ed90d25a-b46e-4ff8-bbe4-15e5c01b47f0 req-635e3bf4-92a4-465a-95e7-b4b54e1b92e9 service nova] Creating event network-changed:4788e653-d0af-42d0-876b-aa680735e98c for instance 22505cde-212d-4415-a77d-4d8e5d1a37d3 on hv-cinder-83538 Jul 26 17:23:33.153088 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-ed90d25a-b46e-4ff8-bbe4-15e5c01b47f0 req-635e3bf4-92a4-465a-95e7-b4b54e1b92e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035898 Jul 26 17:23:33.154248 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 527/1114] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:23:45.904231 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4773752a-f3b5-4b32-96b2-6ceba967fad9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-255477186"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:23:45.904875 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4773752a-f3b5-4b32-96b2-6ceba967fad9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:45.907799 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:23:45.909159 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=57 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:23:45.916339 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4773752a-f3b5-4b32-96b2-6ceba967fad9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:45.916792 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4773752a-f3b5-4b32-96b2-6ceba967fad9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:45.917604 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4773752a-f3b5-4b32-96b2-6ceba967fad9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:45.918036 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4773752a-f3b5-4b32-96b2-6ceba967fad9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:46.057282 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.network.security_group_api [None req-4773752a-f3b5-4b32-96b2-6ceba967fad9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Removing security group 1fdc36a1-c2a4-4127-b834-399d561bc4a3 from port b603904b-5bde-4d58-a55d-31697cdbd992 Jul 26 17:23:46.422340 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4773752a-f3b5-4b32-96b2-6ceba967fad9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "POST /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/action" status: 202 len: 0 microversion: 2.1 time: 0.521902 Jul 26 17:23:46.427868 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 588/1115] 10.222.0.48 () {60 vars in 1278 bytes} [Tue Jul 26 17:23:45 2022] POST /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:23:46.433443 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=9 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:23:46.434807 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=21 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:23:46.440315 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-0106dde5-7029-4add-8079-f6c4123610dc req-80bbbd53-d76b-46d5-addb-d60074398b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674d4fc8-17c5-43c4-bde5-5db8d72cf80c", "tag": "b603904b-5bde-4d58-a55d-31697cdbd992"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:23:46.474945 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-0106dde5-7029-4add-8079-f6c4123610dc req-80bbbd53-d76b-46d5-addb-d60074398b9f service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:46.475750 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-0106dde5-7029-4add-8079-f6c4123610dc req-80bbbd53-d76b-46d5-addb-d60074398b9f service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:46.489706 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-0106dde5-7029-4add-8079-f6c4123610dc req-80bbbd53-d76b-46d5-addb-d60074398b9f service nova] Creating event network-changed:b603904b-5bde-4d58-a55d-31697cdbd992 for instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c on hv-cinder-83538 Jul 26 17:23:46.497245 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-0106dde5-7029-4add-8079-f6c4123610dc req-80bbbd53-d76b-46d5-addb-d60074398b9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064882 Jul 26 17:23:46.499132 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 528/1116] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:23:47.919351 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-325e4303-3d30-44c1-be4d-af7add6ad6dc tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:47.919918 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-325e4303-3d30-44c1-be4d-af7add6ad6dc tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:47.929532 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-325e4303-3d30-44c1-be4d-af7add6ad6dc tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:47.930049 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-325e4303-3d30-44c1-be4d-af7add6ad6dc tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:47.931149 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-325e4303-3d30-44c1-be4d-af7add6ad6dc tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:47.931688 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-325e4303-3d30-44c1-be4d-af7add6ad6dc tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:48.023113 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-325e4303-3d30-44c1-be4d-af7add6ad6dc tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lazy-loading 'services' on Instance uuid 674d4fc8-17c5-43c4-bde5-5db8d72cf80c {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:23:48.071321 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-58acecf5-6249-45c6-9ffe-382a87b5ca89 req-5b0eb73d-a2b2-4603-b2a7-e6fb0bf7f26d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674d4fc8-17c5-43c4-bde5-5db8d72cf80c", "tag": "b603904b-5bde-4d58-a55d-31697cdbd992"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:23:48.091391 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-58acecf5-6249-45c6-9ffe-382a87b5ca89 req-5b0eb73d-a2b2-4603-b2a7-e6fb0bf7f26d service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:48.091887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-58acecf5-6249-45c6-9ffe-382a87b5ca89 req-5b0eb73d-a2b2-4603-b2a7-e6fb0bf7f26d service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:48.113772 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-58acecf5-6249-45c6-9ffe-382a87b5ca89 req-5b0eb73d-a2b2-4603-b2a7-e6fb0bf7f26d service nova] Creating event network-changed:b603904b-5bde-4d58-a55d-31697cdbd992 for instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c on hv-cinder-83538 Jul 26 17:23:48.117062 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-325e4303-3d30-44c1-be4d-af7add6ad6dc tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "DELETE /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/os-volume_attachments/1beeb385-4772-4ee5-8273-5961bb99b453" status: 202 len: 0 microversion: 2.1 time: 0.200896 Jul 26 17:23:48.119560 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-58acecf5-6249-45c6-9ffe-382a87b5ca89 req-5b0eb73d-a2b2-4603-b2a7-e6fb0bf7f26d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200133 Jul 26 17:23:48.120178 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 529/1117] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:23:48.120890 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 589/1118] 10.222.0.48 () {58 vars in 1416 bytes} [Tue Jul 26 17:23:47 2022] DELETE /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/os-volume_attachments/1beeb385-4772-4ee5-8273-5961bb99b453 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:23:48.137315 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-c13af1c5-c5cd-4029-8bf1-1a9e3040bf66 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:48.140555 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-c13af1c5-c5cd-4029-8bf1-1a9e3040bf66 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:48.153117 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c13af1c5-c5cd-4029-8bf1-1a9e3040bf66 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:48.155883 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c13af1c5-c5cd-4029-8bf1-1a9e3040bf66 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:48.156851 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c13af1c5-c5cd-4029-8bf1-1a9e3040bf66 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:48.157381 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-c13af1c5-c5cd-4029-8bf1-1a9e3040bf66 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:48.194157 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-c13af1c5-c5cd-4029-8bf1-1a9e3040bf66 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065402 Jul 26 17:23:48.199233 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 530/1119] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:23:48 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:23:49.208131 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-62b2a402-7458-406b-8d35-ffb7d275ef8b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:49.210985 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-62b2a402-7458-406b-8d35-ffb7d275ef8b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:49.218242 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62b2a402-7458-406b-8d35-ffb7d275ef8b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:49.218700 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62b2a402-7458-406b-8d35-ffb7d275ef8b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:49.219575 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62b2a402-7458-406b-8d35-ffb7d275ef8b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:49.220069 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62b2a402-7458-406b-8d35-ffb7d275ef8b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:49.252863 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-62b2a402-7458-406b-8d35-ffb7d275ef8b tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049647 Jul 26 17:23:49.253793 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 590/1120] 10.222.0.48 () {58 vars in 1302 bytes} [Tue Jul 26 17:23:49 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 17:23:49.265056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-fec4f879-3fd8-483a-b13d-50db23585f9c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:49.265665 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-fec4f879-3fd8-483a-b13d-50db23585f9c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:49.273956 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fec4f879-3fd8-483a-b13d-50db23585f9c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:49.274406 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fec4f879-3fd8-483a-b13d-50db23585f9c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:49.275195 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fec4f879-3fd8-483a-b13d-50db23585f9c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:49.275632 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-fec4f879-3fd8-483a-b13d-50db23585f9c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:49.536408 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-fec4f879-3fd8-483a-b13d-50db23585f9c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] HTTP exception thrown: Instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c is not attached to volume 1beeb385-4772-4ee5-8273-5961bb99b453 Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-fec4f879-3fd8-483a-b13d-50db23585f9c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Request method failure captured: Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: DELETE /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/os-volume_attachments/1beeb385-4772-4ee5-8273-5961bb99b453 HTTP/1.1 Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CKSdZo2cPWL5jfYyeHO8XlRy9hCZFxN0t_gfgKzuQVzyIhlEE6-ZReeogvcfhdJ7ixob2tPBWIew8RzNKga-Z1n4R6YgFnXR0xYKNzMxpqo2tfWr9M66Uq1hs5GzbN8QT0c_AbPSRfSnHvwNObjwchgMHw6nIo6_BnrfDdyGmxZCzE Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 6bc7b7b99e854517a3a43d0b7f7b471a Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-TestMinimumBasicScenario-810718415 Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:23:49.538799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:23:49.540712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6bc7b7b99e854517a3a43d0b7f7b471a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6bc7b7b99e854517a3a43d0b7f7b471a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6bc7b7b99e854517a3a43d0b7f7b471a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6bc7b7b99e854517a3a43d0b7f7b471a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:23:49.540712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-TestMinimumBasicScenario-810718415 Jul 26 17:23:49.540712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 6bc7b7b99e854517a3a43d0b7f7b471a Jul 26 17:23:49.540712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-TestMinimumBasicScenario-810718415 Jul 26 17:23:49.540712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-TestMinimumBasicScenario-810718415-project Jul 26 17:23:49.540712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:23:49.540712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:23:49.540712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: 154a6b37687d471da649a8f6727d751e Jul 26 17:23:49.540712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-TestMinimumBasicScenario-810718415-project Jul 26 17:23:49.540712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:23:49.540712 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c is not attached to volume 1beeb385-4772-4ee5-8273-5961bb99b453 Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'server_id': '674d4fc8-17c5-43c4-bde5-5db8d72cf80c', 'id': '1beeb385-4772-4ee5-8273-5961bb99b453'} Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1beeb385-4772-4ee5-8273-5961bb99b453. Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:23:49.541627 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c is not attached to volume 1beeb385-4772-4ee5-8273-5961bb99b453 Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c is not attached to volume 1beeb385-4772-4ee5-8273-5961bb99b453 Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:23:49.543119 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-fec4f879-3fd8-483a-b13d-50db23585f9c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Returning 404 to user: Instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c is not attached to volume 1beeb385-4772-4ee5-8273-5961bb99b453 {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:23:49.544903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-fec4f879-3fd8-483a-b13d-50db23585f9c tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "DELETE /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/os-volume_attachments/1beeb385-4772-4ee5-8273-5961bb99b453" status: 404 len: 154 microversion: 2.1 time: 0.279934 Jul 26 17:23:49.544903 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 531/1121] 10.222.0.48 () {58 vars in 1416 bytes} [Tue Jul 26 17:23:49 2022] DELETE /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c/os-volume_attachments/1beeb385-4772-4ee5-8273-5961bb99b453 => generated 154 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 17:23:50.704014 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0fb71adf-9ccf-4352-b398-5bb22cbbf816 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:50.704603 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0fb71adf-9ccf-4352-b398-5bb22cbbf816 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:50.711299 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fb71adf-9ccf-4352-b398-5bb22cbbf816 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:50.711750 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fb71adf-9ccf-4352-b398-5bb22cbbf816 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:50.712506 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fb71adf-9ccf-4352-b398-5bb22cbbf816 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:50.712936 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fb71adf-9ccf-4352-b398-5bb22cbbf816 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:50.738722 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0fb71adf-9ccf-4352-b398-5bb22cbbf816 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:23:50.812791 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0fb71adf-9ccf-4352-b398-5bb22cbbf816 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "DELETE /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 204 len: 0 microversion: 2.1 time: 0.112335 Jul 26 17:23:50.814143 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 591/1122] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:23:50 2022] DELETE /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:23:50.822587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-35c274bd-e3c4-4b91-86f4-99d26f441b07 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:50.823982 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-35c274bd-e3c4-4b91-86f4-99d26f441b07 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:50.832269 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-35c274bd-e3c4-4b91-86f4-99d26f441b07 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:50.832724 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-35c274bd-e3c4-4b91-86f4-99d26f441b07 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:50.833544 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-35c274bd-e3c4-4b91-86f4-99d26f441b07 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:50.833977 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-35c274bd-e3c4-4b91-86f4-99d26f441b07 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:50.966191 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-35c274bd-e3c4-4b91-86f4-99d26f441b07 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:50.974170 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-35c274bd-e3c4-4b91-86f4-99d26f441b07 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1556 microversion: 2.1 time: 0.155934 Jul 26 17:23:50.974718 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 532/1123] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:50 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 17:23:51.996217 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5177b827-d96e-4f0a-a3be-9c7ea7db9408 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:51.997216 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5177b827-d96e-4f0a-a3be-9c7ea7db9408 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:52.004727 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5177b827-d96e-4f0a-a3be-9c7ea7db9408 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:52.005209 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5177b827-d96e-4f0a-a3be-9c7ea7db9408 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:52.005979 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5177b827-d96e-4f0a-a3be-9c7ea7db9408 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:52.006411 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5177b827-d96e-4f0a-a3be-9c7ea7db9408 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:52.137035 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5177b827-d96e-4f0a-a3be-9c7ea7db9408 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:52.144765 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5177b827-d96e-4f0a-a3be-9c7ea7db9408 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1556 microversion: 2.1 time: 0.152738 Jul 26 17:23:52.145369 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 592/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:51 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:53.166158 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-6753df0f-e6a4-4cb0-8575-0a9a00e4c297 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:53.166768 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-6753df0f-e6a4-4cb0-8575-0a9a00e4c297 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:53.173260 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6753df0f-e6a4-4cb0-8575-0a9a00e4c297 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:53.173708 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6753df0f-e6a4-4cb0-8575-0a9a00e4c297 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:53.174472 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6753df0f-e6a4-4cb0-8575-0a9a00e4c297 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:53.174899 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-6753df0f-e6a4-4cb0-8575-0a9a00e4c297 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:53.305887 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-6753df0f-e6a4-4cb0-8575-0a9a00e4c297 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154a6b37687d471da649a8f6727d751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc7b7b99e854517a3a43d0b7f7b471a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:23:53.313931 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-6753df0f-e6a4-4cb0-8575-0a9a00e4c297 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 200 len: 1556 microversion: 2.1 time: 0.151064 Jul 26 17:23:53.320855 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 533/1125] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:53 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:23:53.490768 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-e0ce6115-2890-46ef-b61e-ffff133f7f26 req-fdc69737-ca11-440e-bc09-f46abd7463fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674d4fc8-17c5-43c4-bde5-5db8d72cf80c", "name": "network-vif-deleted", "tag": "b603904b-5bde-4d58-a55d-31697cdbd992"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:23:53.500904 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e0ce6115-2890-46ef-b61e-ffff133f7f26 req-fdc69737-ca11-440e-bc09-f46abd7463fe service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:53.501979 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e0ce6115-2890-46ef-b61e-ffff133f7f26 req-fdc69737-ca11-440e-bc09-f46abd7463fe service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:53.514401 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-e0ce6115-2890-46ef-b61e-ffff133f7f26 req-fdc69737-ca11-440e-bc09-f46abd7463fe service nova] Creating event network-vif-deleted:b603904b-5bde-4d58-a55d-31697cdbd992 for instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c on hv-cinder-83538 Jul 26 17:23:53.520091 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-e0ce6115-2890-46ef-b61e-ffff133f7f26 req-fdc69737-ca11-440e-bc09-f46abd7463fe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097572 Jul 26 17:23:53.520706 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 593/1126] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:23:54.335883 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ce36a654-74d7-4de2-90d6-e58f230eecc9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:54.336482 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ce36a654-74d7-4de2-90d6-e58f230eecc9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] [instance: 674d4fc8-17c5-43c4-bde5-5db8d72cf80c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:23:54.343147 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ce36a654-74d7-4de2-90d6-e58f230eecc9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:54.343587 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ce36a654-74d7-4de2-90d6-e58f230eecc9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:54.344340 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ce36a654-74d7-4de2-90d6-e58f230eecc9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:23:54.344794 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ce36a654-74d7-4de2-90d6-e58f230eecc9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:23:54.358177 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-ce36a654-74d7-4de2-90d6-e58f230eecc9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] HTTP exception thrown: Instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c could not be found. Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ce36a654-74d7-4de2-90d6-e58f230eecc9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Request method failure captured: Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c HTTP/1.1 Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CKSdZo2cPWL5jfYyeHO8XlRy9hCZFxN0t_gfgKzuQVzyIhlEE6-ZReeogvcfhdJ7ixob2tPBWIew8RzNKga-Z1n4R6YgFnXR0xYKNzMxpqo2tfWr9M66Uq1hs5GzbN8QT0c_AbPSRfSnHvwNObjwchgMHw6nIo6_BnrfDdyGmxZCzE Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: 6bc7b7b99e854517a3a43d0b7f7b471a Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-TestMinimumBasicScenario-810718415 Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:23:54.359681 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:23:54.362057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6bc7b7b99e854517a3a43d0b7f7b471a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6bc7b7b99e854517a3a43d0b7f7b471a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6bc7b7b99e854517a3a43d0b7f7b471a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6bc7b7b99e854517a3a43d0b7f7b471a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:23:54.362057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-TestMinimumBasicScenario-810718415 Jul 26 17:23:54.362057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: 6bc7b7b99e854517a3a43d0b7f7b471a Jul 26 17:23:54.362057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-TestMinimumBasicScenario-810718415 Jul 26 17:23:54.362057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-TestMinimumBasicScenario-810718415-project Jul 26 17:23:54.362057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:23:54.362057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:23:54.362057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: 154a6b37687d471da649a8f6727d751e Jul 26 17:23:54.362057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-TestMinimumBasicScenario-810718415-project Jul 26 17:23:54.362057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:23:54.362057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c could not be found. Jul 26 17:23:54.362057 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '674d4fc8-17c5-43c4-bde5-5db8d72cf80c'} Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c could not be found. Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:23:54.362972 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c could not be found. Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c could not be found. Jul 26 17:23:54.364261 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:23:54.365800 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ce36a654-74d7-4de2-90d6-e58f230eecc9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Returning 404 to user: Instance 674d4fc8-17c5-43c4-bde5-5db8d72cf80c could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:23:54.365800 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ce36a654-74d7-4de2-90d6-e58f230eecc9 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c" status: 404 len: 111 microversion: 2.1 time: 0.029614 Jul 26 17:23:54.365800 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 534/1127] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:23:54 2022] GET /compute/v2.1/servers/674d4fc8-17c5-43c4-bde5-5db8d72cf80c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:23:54.371162 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e030abb9-f5d5-4bc5-ab42-0a23b36b34d4 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] Calling method '.version_select at 0x7f6ca8938f70>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:23:54.393753 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e030abb9-f5d5-4bc5-ab42-0a23b36b34d4 tempest-TestMinimumBasicScenario-810718415 tempest-TestMinimumBasicScenario-810718415-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1454353036" status: 202 len: 0 microversion: 2.1 time: 0.026673 Jul 26 17:23:54.394324 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 594/1128] 10.222.0.48 () {58 vars in 1272 bytes} [Tue Jul 26 17:23:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1454353036 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:25:03.676077 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_api:SELECT=14 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:25:03.677667 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG dbcounter [-] [118122] Writing DB stats nova_cell1:SELECT=30 {{(pid=118122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:25:03.680091 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:25:03.680920 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 17:25:03.683513 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-9cb90d29-d1a0-4311-803c-4505a9a0b1d8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:03.684046 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9cb90d29-d1a0-4311-803c-4505a9a0b1d8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:03.685402 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-17068e80-c87f-4c21-a1cf-4e6eaaf1a829 req-c78a4b77-2e8b-4520-a6d4-b08388edf859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22505cde-212d-4415-a77d-4d8e5d1a37d3", "tag": "4788e653-d0af-42d0-876b-aa680735e98c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:25:03.692564 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9cb90d29-d1a0-4311-803c-4505a9a0b1d8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:03.693317 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9cb90d29-d1a0-4311-803c-4505a9a0b1d8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:03.694102 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9cb90d29-d1a0-4311-803c-4505a9a0b1d8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:03.694674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-9cb90d29-d1a0-4311-803c-4505a9a0b1d8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:03.697547 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-17068e80-c87f-4c21-a1cf-4e6eaaf1a829 req-c78a4b77-2e8b-4520-a6d4-b08388edf859 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:03.697901 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-17068e80-c87f-4c21-a1cf-4e6eaaf1a829 req-c78a4b77-2e8b-4520-a6d4-b08388edf859 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:03.710969 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-17068e80-c87f-4c21-a1cf-4e6eaaf1a829 req-c78a4b77-2e8b-4520-a6d4-b08388edf859 service nova] Creating event network-changed:4788e653-d0af-42d0-876b-aa680735e98c for instance 22505cde-212d-4415-a77d-4d8e5d1a37d3 on hv-cinder-83538 Jul 26 17:25:03.716254 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-17068e80-c87f-4c21-a1cf-4e6eaaf1a829 req-c78a4b77-2e8b-4520-a6d4-b08388edf859 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038553 Jul 26 17:25:03.717044 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 595/1129] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:25:03.724623 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-9cb90d29-d1a0-4311-803c-4505a9a0b1d8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Going to try to terminate instance {{(pid=118122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:25:03.816108 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-9cb90d29-d1a0-4311-803c-4505a9a0b1d8 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "DELETE /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 204 len: 0 microversion: 2.1 time: 0.141613 Jul 26 17:25:03.821110 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 535/1130] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:25:03 2022] DELETE /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 17:25:03.827594 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d7b54d17-a8c6-4e85-a030-412a57a3fa0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:03.828227 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d7b54d17-a8c6-4e85-a030-412a57a3fa0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:03.835408 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7b54d17-a8c6-4e85-a030-412a57a3fa0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:03.835870 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7b54d17-a8c6-4e85-a030-412a57a3fa0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:03.836668 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7b54d17-a8c6-4e85-a030-412a57a3fa0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:03.837152 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7b54d17-a8c6-4e85-a030-412a57a3fa0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:04.017129 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d7b54d17-a8c6-4e85-a030-412a57a3fa0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:25:04.024823 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d7b54d17-a8c6-4e85-a030-412a57a3fa0c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1577 microversion: 2.1 time: 0.202956 Jul 26 17:25:04.025426 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 596/1131] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:25:03 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:25:05.046349 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-aa8d5da6-ca72-4a70-91e2-eb8f1f8bbf68 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:05.046938 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-aa8d5da6-ca72-4a70-91e2-eb8f1f8bbf68 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:05.053691 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aa8d5da6-ca72-4a70-91e2-eb8f1f8bbf68 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:05.054143 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aa8d5da6-ca72-4a70-91e2-eb8f1f8bbf68 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:05.054914 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aa8d5da6-ca72-4a70-91e2-eb8f1f8bbf68 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:05.055374 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-aa8d5da6-ca72-4a70-91e2-eb8f1f8bbf68 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:05.195664 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-aa8d5da6-ca72-4a70-91e2-eb8f1f8bbf68 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:25:05.203514 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-aa8d5da6-ca72-4a70-91e2-eb8f1f8bbf68 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1577 microversion: 2.1 time: 0.161479 Jul 26 17:25:05.205121 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 536/1132] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:25:05 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:25:06.226627 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fc2ce55b-b5e4-4873-a085-a940df4cbd67 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:06.227418 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fc2ce55b-b5e4-4873-a085-a940df4cbd67 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:06.233980 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc2ce55b-b5e4-4873-a085-a940df4cbd67 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:06.234437 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc2ce55b-b5e4-4873-a085-a940df4cbd67 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:06.236516 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc2ce55b-b5e4-4873-a085-a940df4cbd67 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:06.236985 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc2ce55b-b5e4-4873-a085-a940df4cbd67 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:06.329219 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fc2ce55b-b5e4-4873-a085-a940df4cbd67 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:25:06.336799 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fc2ce55b-b5e4-4873-a085-a940df4cbd67 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1391 microversion: 2.1 time: 0.114094 Jul 26 17:25:06.337418 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 597/1133] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:25:06 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1391 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:25:06.378836 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-3a94d545-82a3-4a67-85d0-80bbd543f05f req-6377f9a6-a4ff-4728-912f-23bfc7f7f912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22505cde-212d-4415-a77d-4d8e5d1a37d3", "name": "network-vif-deleted", "tag": "4788e653-d0af-42d0-876b-aa680735e98c"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:25:06.391091 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-3a94d545-82a3-4a67-85d0-80bbd543f05f req-6377f9a6-a4ff-4728-912f-23bfc7f7f912 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:06.391678 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-3a94d545-82a3-4a67-85d0-80bbd543f05f req-6377f9a6-a4ff-4728-912f-23bfc7f7f912 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:06.405815 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-3a94d545-82a3-4a67-85d0-80bbd543f05f req-6377f9a6-a4ff-4728-912f-23bfc7f7f912 service nova] Creating event network-vif-deleted:4788e653-d0af-42d0-876b-aa680735e98c for instance 22505cde-212d-4415-a77d-4d8e5d1a37d3 on hv-cinder-83538 Jul 26 17:25:06.412359 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-3a94d545-82a3-4a67-85d0-80bbd543f05f req-6377f9a6-a4ff-4728-912f-23bfc7f7f912 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037425 Jul 26 17:25:06.413208 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 537/1134] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:25:07.358049 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-43f75d73-1450-42f9-a9c8-92e5fdecb66b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:07.358726 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-43f75d73-1450-42f9-a9c8-92e5fdecb66b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:07.365900 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43f75d73-1450-42f9-a9c8-92e5fdecb66b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:07.366363 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43f75d73-1450-42f9-a9c8-92e5fdecb66b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:07.367141 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43f75d73-1450-42f9-a9c8-92e5fdecb66b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:07.367588 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43f75d73-1450-42f9-a9c8-92e5fdecb66b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:07.405553 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43f75d73-1450-42f9-a9c8-92e5fdecb66b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:07.406072 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43f75d73-1450-42f9-a9c8-92e5fdecb66b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:07.406600 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-43f75d73-1450-42f9-a9c8-92e5fdecb66b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lazy-loading 'fault' on Instance uuid 22505cde-212d-4415-a77d-4d8e5d1a37d3 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:25:07.455013 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-43f75d73-1450-42f9-a9c8-92e5fdecb66b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:25:07.461861 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-43f75d73-1450-42f9-a9c8-92e5fdecb66b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 200 len: 1185 microversion: 2.1 time: 0.107754 Jul 26 17:25:07.462436 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 598/1135] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:25:07 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 1185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:25:08.485990 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2fcee919-fc9e-460c-a1b4-6d14c8f8c68a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:08.486714 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-2fcee919-fc9e-460c-a1b4-6d14c8f8c68a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 22505cde-212d-4415-a77d-4d8e5d1a37d3] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:08.492841 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2fcee919-fc9e-460c-a1b4-6d14c8f8c68a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:08.493321 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2fcee919-fc9e-460c-a1b4-6d14c8f8c68a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:08.494082 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2fcee919-fc9e-460c-a1b4-6d14c8f8c68a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:08.494515 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-2fcee919-fc9e-460c-a1b4-6d14c8f8c68a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:08.509071 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-2fcee919-fc9e-460c-a1b4-6d14c8f8c68a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] HTTP exception thrown: Instance 22505cde-212d-4415-a77d-4d8e5d1a37d3 could not be found. Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2fcee919-fc9e-460c-a1b4-6d14c8f8c68a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Request method failure captured: Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 HTTP/1.1 Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CGnujxWd0FjjiQ0ACbbZRG7WH8zUF71oGkyN9PyaPeUq_7SQMn3dkCArL-V3RWfebePx5l38h2REnFy4Z85kMOmvCxTNw0TwZZRP345HeL0zWAhoMshwJb4pyue9mArAHVPxAz_UhOHyyXtU2cQIdzUm3V9-NnKiejjX8pKmyF4mPo Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: b888b1053bb043dbb88d674c9a504a86 Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-TestVolumeBootPattern-923472015 Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:25:08.510674 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:25:08.512456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:25:08.512456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-TestVolumeBootPattern-923472015 Jul 26 17:25:08.512456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: b888b1053bb043dbb88d674c9a504a86 Jul 26 17:25:08.512456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-TestVolumeBootPattern-923472015 Jul 26 17:25:08.512456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-TestVolumeBootPattern-923472015-project Jul 26 17:25:08.512456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:25:08.512456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:25:08.512456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: dcf968aeb53c4215927642e9931b4a5e Jul 26 17:25:08.512456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-TestVolumeBootPattern-923472015-project Jul 26 17:25:08.512456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:25:08.512456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance 22505cde-212d-4415-a77d-4d8e5d1a37d3 could not be found. Jul 26 17:25:08.512456 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': '22505cde-212d-4415-a77d-4d8e5d1a37d3'} Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22505cde-212d-4415-a77d-4d8e5d1a37d3 could not be found. Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:25:08.513404 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22505cde-212d-4415-a77d-4d8e5d1a37d3 could not be found. Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22505cde-212d-4415-a77d-4d8e5d1a37d3 could not be found. Jul 26 17:25:08.514828 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:25:08.516094 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-2fcee919-fc9e-460c-a1b4-6d14c8f8c68a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Returning 404 to user: Instance 22505cde-212d-4415-a77d-4d8e5d1a37d3 could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:25:08.516094 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-2fcee919-fc9e-460c-a1b4-6d14c8f8c68a tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3" status: 404 len: 111 microversion: 2.1 time: 0.031273 Jul 26 17:25:08.516094 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 538/1136] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:25:08 2022] GET /compute/v2.1/servers/22505cde-212d-4415-a77d-4d8e5d1a37d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:25:11.606025 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [req-ad820c6c-e8ba-4a1a-a6dc-b1bae537307e req-15f8cd30-2316-4637-b57f-cf66adf65c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57f28568-123d-4639-84a9-4d0c501c1b44", "tag": "4ee619b1-bb35-434c-bfa4-65aff71afd6b"}]} {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:25:11.606839 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-03828171-3063-449b-9e88-c147c89f1292 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:11.607350 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-03828171-3063-449b-9e88-c147c89f1292 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:11.614731 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03828171-3063-449b-9e88-c147c89f1292 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:11.615190 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03828171-3063-449b-9e88-c147c89f1292 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:11.615983 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03828171-3063-449b-9e88-c147c89f1292 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:11.616181 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-ad820c6c-e8ba-4a1a-a6dc-b1bae537307e req-15f8cd30-2316-4637-b57f-cf66adf65c62 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:11.616425 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03828171-3063-449b-9e88-c147c89f1292 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:11.616845 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [req-ad820c6c-e8ba-4a1a-a6dc-b1bae537307e req-15f8cd30-2316-4637-b57f-cf66adf65c62 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:11.631333 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.compute.server_external_events [req-ad820c6c-e8ba-4a1a-a6dc-b1bae537307e req-15f8cd30-2316-4637-b57f-cf66adf65c62 service nova] Creating event network-changed:4ee619b1-bb35-434c-bfa4-65aff71afd6b for instance 57f28568-123d-4639-84a9-4d0c501c1b44 on hv-cinder-83538 Jul 26 17:25:11.637269 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [req-ad820c6c-e8ba-4a1a-a6dc-b1bae537307e req-15f8cd30-2316-4637-b57f-cf66adf65c62 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034783 Jul 26 17:25:11.638197 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 539/1137] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 17:25:11.648947 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-03828171-3063-449b-9e88-c147c89f1292 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 17:25:11.758728 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-03828171-3063-449b-9e88-c147c89f1292 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "DELETE /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 204 len: 0 microversion: 2.1 time: 0.159157 Jul 26 17:25:11.759350 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 599/1138] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:25:11 2022] DELETE /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 17:25:11.768862 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-db76d16e-df5d-40be-94c2-0da376b8387d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:11.769596 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-db76d16e-df5d-40be-94c2-0da376b8387d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:11.780326 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-db76d16e-df5d-40be-94c2-0da376b8387d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:11.781262 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-db76d16e-df5d-40be-94c2-0da376b8387d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:11.782995 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-db76d16e-df5d-40be-94c2-0da376b8387d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:11.783799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-db76d16e-df5d-40be-94c2-0da376b8387d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:11.936675 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-db76d16e-df5d-40be-94c2-0da376b8387d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:25:11.947469 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-db76d16e-df5d-40be-94c2-0da376b8387d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1577 microversion: 2.1 time: 0.183388 Jul 26 17:25:11.948258 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 540/1139] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:25:11 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:25:12.970384 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b24ceafb-da2f-429a-b8c5-663c5d6619ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:12.971081 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b24ceafb-da2f-429a-b8c5-663c5d6619ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:12.977549 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b24ceafb-da2f-429a-b8c5-663c5d6619ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:12.978008 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b24ceafb-da2f-429a-b8c5-663c5d6619ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:12.978820 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b24ceafb-da2f-429a-b8c5-663c5d6619ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:12.979195 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b24ceafb-da2f-429a-b8c5-663c5d6619ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:13.119524 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b24ceafb-da2f-429a-b8c5-663c5d6619ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:25:13.127718 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b24ceafb-da2f-429a-b8c5-663c5d6619ad tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1577 microversion: 2.1 time: 0.162055 Jul 26 17:25:13.132319 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 600/1140] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:25:12 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:25:14.152045 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-065f9860-235f-45ce-8414-484483a84fee tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:14.152787 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-065f9860-235f-45ce-8414-484483a84fee tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:14.159910 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-065f9860-235f-45ce-8414-484483a84fee tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:14.160367 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-065f9860-235f-45ce-8414-484483a84fee tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:14.161346 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-065f9860-235f-45ce-8414-484483a84fee tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:14.161783 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-065f9860-235f-45ce-8414-484483a84fee tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:14.306684 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-065f9860-235f-45ce-8414-484483a84fee tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:25:14.317706 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-065f9860-235f-45ce-8414-484483a84fee tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1459 microversion: 2.1 time: 0.169518 Jul 26 17:25:14.318295 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 541/1141] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:25:14 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1459 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:25:14.572608 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-af2e9220-a5a0-4efa-a68e-736cb6ceca09 req-7b7b61f7-018d-4505-b855-09ec47a4fe29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57f28568-123d-4639-84a9-4d0c501c1b44", "name": "network-vif-deleted", "tag": "4ee619b1-bb35-434c-bfa4-65aff71afd6b"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 17:25:14.583042 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-af2e9220-a5a0-4efa-a68e-736cb6ceca09 req-7b7b61f7-018d-4505-b855-09ec47a4fe29 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:14.583481 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-af2e9220-a5a0-4efa-a68e-736cb6ceca09 req-7b7b61f7-018d-4505-b855-09ec47a4fe29 service nova] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:14.595407 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-af2e9220-a5a0-4efa-a68e-736cb6ceca09 req-7b7b61f7-018d-4505-b855-09ec47a4fe29 service nova] Creating event network-vif-deleted:4ee619b1-bb35-434c-bfa4-65aff71afd6b for instance 57f28568-123d-4639-84a9-4d0c501c1b44 on hv-cinder-83538 Jul 26 17:25:14.600377 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-af2e9220-a5a0-4efa-a68e-736cb6ceca09 req-7b7b61f7-018d-4505-b855-09ec47a4fe29 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031306 Jul 26 17:25:14.601178 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 601/1142] 10.222.0.48 () {64 vars in 1317 bytes} [Tue Jul 26 17:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 17:25:15.339356 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ec60bb19-9c7c-4390-b290-d136819f6d0b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:15.339964 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ec60bb19-9c7c-4390-b290-d136819f6d0b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:15.346503 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ec60bb19-9c7c-4390-b290-d136819f6d0b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:15.346953 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ec60bb19-9c7c-4390-b290-d136819f6d0b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:15.347726 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ec60bb19-9c7c-4390-b290-d136819f6d0b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:15.348163 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ec60bb19-9c7c-4390-b290-d136819f6d0b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:15.381689 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ec60bb19-9c7c-4390-b290-d136819f6d0b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:15.382137 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ec60bb19-9c7c-4390-b290-d136819f6d0b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:15.382585 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.objects.instance [None req-ec60bb19-9c7c-4390-b290-d136819f6d0b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lazy-loading 'fault' on Instance uuid 57f28568-123d-4639-84a9-4d0c501c1b44 {{(pid=118122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 17:25:15.429307 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.policy [None req-ec60bb19-9c7c-4390-b290-d136819f6d0b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf968aeb53c4215927642e9931b4a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b888b1053bb043dbb88d674c9a504a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118122) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 17:25:15.437630 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ec60bb19-9c7c-4390-b290-d136819f6d0b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 200 len: 1231 microversion: 2.1 time: 0.102026 Jul 26 17:25:15.439164 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 542/1143] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:25:15 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 17:25:16.461004 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-86304bd1-d1a9-4a9f-9cae-31408ca5c02c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:16.461705 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-86304bd1-d1a9-4a9f-9cae-31408ca5c02c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: 57f28568-123d-4639-84a9-4d0c501c1b44] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:16.468265 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86304bd1-d1a9-4a9f-9cae-31408ca5c02c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:16.468769 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86304bd1-d1a9-4a9f-9cae-31408ca5c02c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:16.470127 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86304bd1-d1a9-4a9f-9cae-31408ca5c02c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:16.470607 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86304bd1-d1a9-4a9f-9cae-31408ca5c02c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:16.483772 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-86304bd1-d1a9-4a9f-9cae-31408ca5c02c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] HTTP exception thrown: Instance 57f28568-123d-4639-84a9-4d0c501c1b44 could not be found. Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-86304bd1-d1a9-4a9f-9cae-31408ca5c02c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Request method failure captured: Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 HTTP/1.1 Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CGnujxWd0FjjiQ0ACbbZRG7WH8zUF71oGkyN9PyaPeUq_7SQMn3dkCArL-V3RWfebePx5l38h2REnFy4Z85kMOmvCxTNw0TwZZRP345HeL0zWAhoMshwJb4pyue9mArAHVPxAz_UhOHyyXtU2cQIdzUm3V9-NnKiejjX8pKmyF4mPo Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: b888b1053bb043dbb88d674c9a504a86 Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-TestVolumeBootPattern-923472015 Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:25:16.486307 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:25:16.489221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:25:16.489221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-TestVolumeBootPattern-923472015 Jul 26 17:25:16.489221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: b888b1053bb043dbb88d674c9a504a86 Jul 26 17:25:16.489221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-TestVolumeBootPattern-923472015 Jul 26 17:25:16.489221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-TestVolumeBootPattern-923472015-project Jul 26 17:25:16.489221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:25:16.489221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:25:16.489221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: dcf968aeb53c4215927642e9931b4a5e Jul 26 17:25:16.489221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-TestVolumeBootPattern-923472015-project Jul 26 17:25:16.489221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:25:16.489221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance 57f28568-123d-4639-84a9-4d0c501c1b44 could not be found. Jul 26 17:25:16.489221 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': '57f28568-123d-4639-84a9-4d0c501c1b44'} Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57f28568-123d-4639-84a9-4d0c501c1b44 could not be found. Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:25:16.490399 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57f28568-123d-4639-84a9-4d0c501c1b44 could not be found. Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57f28568-123d-4639-84a9-4d0c501c1b44 could not be found. Jul 26 17:25:16.491990 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:25:16.493938 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-86304bd1-d1a9-4a9f-9cae-31408ca5c02c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Returning 404 to user: Instance 57f28568-123d-4639-84a9-4d0c501c1b44 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:25:16.493938 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-86304bd1-d1a9-4a9f-9cae-31408ca5c02c tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44" status: 404 len: 111 microversion: 2.1 time: 0.031414 Jul 26 17:25:16.493938 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 602/1144] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:25:16 2022] GET /compute/v2.1/servers/57f28568-123d-4639-84a9-4d0c501c1b44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:25:16.956622 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ea76be5f-df8b-49e2-bbcd-d704a0f6d97d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:16.957595 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.compute.api [None req-ea76be5f-df8b-49e2-bbcd-d704a0f6d97d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118122) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:16.963601 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ea76be5f-df8b-49e2-bbcd-d704a0f6d97d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:16.964047 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ea76be5f-df8b-49e2-bbcd-d704a0f6d97d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:16.964820 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ea76be5f-df8b-49e2-bbcd-d704a0f6d97d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:16.965276 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG oslo_concurrency.lockutils [None req-ea76be5f-df8b-49e2-bbcd-d704a0f6d97d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:16.979753 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.wsgi [None req-ea76be5f-df8b-49e2-bbcd-d704a0f6d97d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] HTTP exception thrown: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ea76be5f-df8b-49e2-bbcd-d704a0f6d97d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Request method failure captured: Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: request: DELETE /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c HTTP/1.1 Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept: application/json Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Accept-Encoding: identity Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Connection: close Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Length: 0 Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Content-Type: application/json Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Host: 10.222.0.48 Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Openstack-System-Scope: None Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: User-Agent: python-urllib3/1.26.10 Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Auth-Token: gAAAAABi4CGnujxWd0FjjiQ0ACbbZRG7WH8zUF71oGkyN9PyaPeUq_7SQMn3dkCArL-V3RWfebePx5l38h2REnFy4Z85kMOmvCxTNw0TwZZRP345HeL0zWAhoMshwJb4pyue9mArAHVPxAz_UhOHyyXtU2cQIdzUm3V9-NnKiejjX8pKmyF4mPo Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Id: None Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Domain-Name: None Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Identity-Status: Confirmed Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Is-Admin-Project: True Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Id: default Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Domain-Name: Default Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Id: b888b1053bb043dbb88d674c9a504a86 Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Project-Name: tempest-TestVolumeBootPattern-923472015 Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Role: member,reader Jul 26 17:25:16.981446 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Roles: member,reader Jul 26 17:25:16.983186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:25:16.983186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant: tempest-TestVolumeBootPattern-923472015 Jul 26 17:25:16.983186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Id: b888b1053bb043dbb88d674c9a504a86 Jul 26 17:25:16.983186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-Tenant-Name: tempest-TestVolumeBootPattern-923472015 Jul 26 17:25:16.983186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User: tempest-TestVolumeBootPattern-923472015-project Jul 26 17:25:16.983186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Id: default Jul 26 17:25:16.983186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Domain-Name: Default Jul 26 17:25:16.983186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Id: dcf968aeb53c4215927642e9931b4a5e Jul 26 17:25:16.983186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: X-User-Name: tempest-TestVolumeBootPattern-923472015-project Jul 26 17:25:16.983186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: method: > Jul 26 17:25:16.983186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: exception: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:25:16.983186 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: action_args: {'id': 'eba8d6de-7d63-4f9a-be56-ff498118e97c'} Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:25:16.984056 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:25:16.985954 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: ERROR nova.api.openstack.wsgi Jul 26 17:25:16.987581 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-ea76be5f-df8b-49e2-bbcd-d704a0f6d97d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Returning 404 to user: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. {{(pid=118122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:25:16.987581 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-ea76be5f-df8b-49e2-bbcd-d704a0f6d97d tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "DELETE /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 404 len: 111 microversion: 2.1 time: 0.031525 Jul 26 17:25:16.987581 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 543/1145] 10.222.0.48 () {58 vars in 1239 bytes} [Tue Jul 26 17:25:16 2022] DELETE /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:25:16.992886 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dca70156-f68c-47bd-8c69-1a06dee0fe5b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:16.993534 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dca70156-f68c-47bd-8c69-1a06dee0fe5b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] [instance: eba8d6de-7d63-4f9a-be56-ff498118e97c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 17:25:17.000205 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dca70156-f68c-47bd-8c69-1a06dee0fe5b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:17.000829 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dca70156-f68c-47bd-8c69-1a06dee0fe5b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:17.001640 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dca70156-f68c-47bd-8c69-1a06dee0fe5b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 17:25:17.002076 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dca70156-f68c-47bd-8c69-1a06dee0fe5b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Lock "de7d5e92-8d50-420a-84c5-3da3d0978a49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 17:25:17.016825 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-dca70156-f68c-47bd-8c69-1a06dee0fe5b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] HTTP exception thrown: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dca70156-f68c-47bd-8c69-1a06dee0fe5b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Request method failure captured: Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c HTTP/1.1 Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept: application/json Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Connection: close Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Host: 10.222.0.48 Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.10 Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABi4CGnujxWd0FjjiQ0ACbbZRG7WH8zUF71oGkyN9PyaPeUq_7SQMn3dkCArL-V3RWfebePx5l38h2REnFy4Z85kMOmvCxTNw0TwZZRP345HeL0zWAhoMshwJb4pyue9mArAHVPxAz_UhOHyyXtU2cQIdzUm3V9-NnKiejjX8pKmyF4mPo Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Id: b888b1053bb043dbb88d674c9a504a86 Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-TestVolumeBootPattern-923472015 Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Role: member,reader Jul 26 17:25:17.018592 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Roles: member,reader Jul 26 17:25:17.020981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b888b1053bb043dbb88d674c9a504a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jul 26 17:25:17.020981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-TestVolumeBootPattern-923472015 Jul 26 17:25:17.020981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Id: b888b1053bb043dbb88d674c9a504a86 Jul 26 17:25:17.020981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-TestVolumeBootPattern-923472015 Jul 26 17:25:17.020981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User: tempest-TestVolumeBootPattern-923472015-project Jul 26 17:25:17.020981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jul 26 17:25:17.020981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jul 26 17:25:17.020981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Id: dcf968aeb53c4215927642e9931b4a5e Jul 26 17:25:17.020981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-TestVolumeBootPattern-923472015-project Jul 26 17:25:17.020981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: method: > Jul 26 17:25:17.020981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: exception: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:25:17.020981 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: action_args: {'id': 'eba8d6de-7d63-4f9a-be56-ff498118e97c'} Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 17:25:17.022313 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. Jul 26 17:25:17.025459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jul 26 17:25:17.027584 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dca70156-f68c-47bd-8c69-1a06dee0fe5b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Returning 404 to user: Instance eba8d6de-7d63-4f9a-be56-ff498118e97c could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 17:25:17.027584 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dca70156-f68c-47bd-8c69-1a06dee0fe5b tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c" status: 404 len: 111 microversion: 2.1 time: 0.031141 Jul 26 17:25:17.027584 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 603/1146] 10.222.0.48 () {58 vars in 1236 bytes} [Tue Jul 26 17:25:16 2022] GET /compute/v2.1/servers/eba8d6de-7d63-4f9a-be56-ff498118e97c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 17:25:18.348780 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: DEBUG nova.api.openstack.wsgi [None req-8d71262f-e51c-425c-bf24-123f85b0a591 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] Calling method '.version_select at 0x7f6ca9452dc0>' {{(pid=118122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 17:25:18.369863 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO nova.api.openstack.requestlog [None req-8d71262f-e51c-425c-bf24-123f85b0a591 tempest-TestVolumeBootPattern-923472015 tempest-TestVolumeBootPattern-923472015-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1393964861" status: 202 len: 0 microversion: 2.1 time: 0.025656 Jul 26 17:25:18.370444 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: [pid: 118122|app: 0|req: 544/1147] 10.222.0.48 () {58 vars in 1263 bytes} [Tue Jul 26 17:25:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1393964861 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 17:26:33.254799 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 17:26:33.255598 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Tue Jul 26 17:26:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 17:26:47.066459 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 17:26:47.067080 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Tue Jul 26 17:26:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 17:28:17.491900 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 17:28:17.492529 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Tue Jul 26 17:28:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 17:28:32.808787 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 17:28:32.809343 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Tue Jul 26 17:28:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 17:29:53.264066 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 17:29:53.264750 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Tue Jul 26 17:29:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 17:30:07.074905 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 17:30:07.076000 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Tue Jul 26 17:30:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 17:30:15.279822 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 17:30:15.280579 dv-cinder-835384-17-iscsi devstack@n-api.service[118121]: Tue Jul 26 17:30:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 17:30:30.407697 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 17:30:30.408154 dv-cinder-835384-17-iscsi devstack@n-api.service[118122]: Tue Jul 26 17:30:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!